QAID Docs

Dashboard & Metrics

The Dashboard provides a comprehensive overview of your project's testing health and quality score.

Overview

Access the Dashboard from the Overview step in the sidebar (first item). It has four tabs:

  • Overview - Quality score, test health summary, action items
  • Issues - Failing tests, flaky tests, slowest tests, open bugs
  • Coverage - Element coverage, flow coverage, page criticality
  • Trends - Quality score and coverage over time

Overview Tab

Quality Score

The centerpiece is a 0-100 quality score with color coding:

Score RangeRatingColor
80-100ExcellentGreen
60-79GoodBlue
40-59FairYellow
0-39PoorRed

The score is calculated from five dimensions:

DimensionWhat It Measures
Test Pass RatePercentage of automated tests passing
StabilityConsistency of test results (detects flaky tests)
CoverageElement and flow test coverage
Bug FreedomOpen bug count and severity
Visual ConsistencyVisual regression baseline pass rate

Test Pass Rate is weighted most heavily, followed by Stability and Coverage. If insufficient data exists for a dimension (e.g., no test runs yet), it shows "N/A" and the score adjusts accordingly.

Missing Data Alerts

When data is insufficient to calculate a reliable score, alerts show what's needed:

  • "Run automated tests to measure pass rate"
  • "Capture visual regression baselines"
  • "Extract elements to measure coverage"

Action Cards

Three quick-glance cards:

  • Failing Tests count (red if > 0, green if 0)
  • Flaky Tests count (yellow if > 0, green if 0)
  • Open Bugs count (red if > 0, green if 0)

Test Summary

  • Automated Tests: Pass rate percentage with (passed/total) count
  • Manual Tests: Pass rate percentage with (executed/total) count

Issues Tab

Lists all current quality issues:

Failing Tests

Tests that failed in the most recent run, with:

  • Test name
  • Source page
  • Failure badge

Flaky Tests

Tests that inconsistently pass/fail, with:

  • Test name
  • Pass rate percentage

Slowest Tests

Tests with longest execution times, with:

  • Test type badge (Auto/Manual)
  • Test name
  • Duration in seconds

Open Bugs

Active bugs detected by QAID, with:

  • Severity badge (Critical/High/Medium/Low)
  • Source page
  • Bug description

Coverage Tab

Combined Coverage Score

A weighted score combining:

  • Element Coverage (40% weight) - Percentage of testable elements with tests
  • Flow Coverage (60% weight) - Percentage of user flows covered by tests

Shows pages-with-coverage count vs. total pages.

Page Criticality Analysis

AI-powered analysis of page importance:

  1. Click "Analyze & Rank Pages" to run AI criticality analysis
  2. AI evaluates each page's purpose and importance
  3. Results show as a drag-and-drop ranked list:
    • Page path with criticality stars (1-5)
    • AI reasoning for the ranking
    • Criticality badge (Critical/High/Medium/Low/Minimal)
  4. Drag pages to reorder rankings
  5. Click "Save Rankings" to persist
CriticalityStarsMeaning
Critical5Core functionality, must always work
High4Important features, high priority
Medium3Standard functionality
Low2Secondary features
Minimal1Lowest priority

Coverage by Page

Expandable table showing per-page coverage:

  • Page path with criticality stars
  • Combined coverage score
  • Element coverage percentage and count
  • Flow coverage percentage and count
  • Flow priority breakdown (Critical/High/Medium/Low)

Critical Uncovered Flows

High-value user flows not yet tested, with:

  • Flow priority badge
  • Flow name
  • Page path

Pages Needing Attention

Pages with low coverage relative to their criticality:

  • Criticality rating
  • Combined score
  • Reason for attention

Visual Regression Status

Summary counts:

  • Total baselines captured
  • Passed comparisons
  • Failed comparisons

Historical charts showing:

  • Quality Score Trend - Bar chart of quality score over time
  • Coverage Trend - Bar chart of coverage percentage over time

Page Criticality Management

How Criticality Is Used

Page criticality affects multiple areas:

  • Test prioritization - Critical pages are tested first
  • Coverage weighting - Critical page coverage matters more
  • Quality score - Critical coverage gaps lower the score
  • Action recommendations - Actions page prioritizes critical pages

AI-Assisted Ranking

QAID's AI suggests criticality based on:

  • Page purpose analysis (login, checkout, dashboard vs. terms of service)
  • Navigation structure position
  • Element importance distribution
  • User interaction patterns

On this page