Test Runs
Execute your test plans and track results in real-time from the Test Run page.
Overview
The Test Run page is where you execute test plans and monitor their progress. Each run executes all tests in a selected test plan (both automated and manual) and produces a pass/fail summary with detailed results.
Starting a Test Run
Creating a New Run
- Navigate to Test Run in the sidebar
- Click "Start Run" in the top-right corner
- In the dialog, configure:
- Test Plan: Select which test plan to execute (required)
- Run Name: Optional label (e.g., "Sprint 12 Regression", "Pre-release check")
- Parallel Tests: How many tests to run simultaneously (1, 2, 3, or 5)
- Click "Start"
Parallelism
Running more tests in parallel speeds up execution but requires more system resources:
| Parallel | Best For |
|---|---|
| 1 | Debugging, resource-constrained environments |
| 2-3 | Standard regression runs |
| 5 | Large test suites on capable hardware |
Auto AI Analysis
Toggle "Auto AI Analysis" in the page header to automatically analyze failures after a run completes. When enabled:
- Failed tests are automatically classified by AI (real bug, expected failure, flaky)
- Results appear in the Analysis page
- Helps prioritize which failures to investigate first
When disabled, runs complete without AI classification (faster, no AI cost).
Run Statuses
| Status | Meaning |
|---|---|
| Created | Run configured but not yet started |
| Running | Tests currently executing |
| Awaiting Manual | Automated tests done, waiting for manual test results |
| Completed | All tests finished |
| Failed | Run encountered an error |
| Cancelled | Run was stopped by user |
| Healing | Self-healing in progress for failed selectors |
Understanding Run Cards
Each run appears as a card showing:
- Status badge with color coding
- Run name or auto-generated number
- Test plan name that was executed
- Created time (relative: "2h ago", "3d ago")
- Duration of the run
- Pass rate percentage with color coding:
- Green: 80%+ passing
- Yellow: 50-79% passing
- Red: Below 50% passing
- Test breakdown: Passed/Total for automated tests and manual tests separately
Progress During Execution
While a run is in progress:
- A progress bar shows completed vs. total tests
- Pass/fail counts update in real-time
- You can navigate away and return — progress is preserved
Viewing Run Details
Click any run card to navigate to the detailed results page, which shows:
- Individual test results (pass/fail/skip)
- Error messages and stack traces for failures
- Screenshots captured during execution
- Execution duration per test
- AI failure classification (if Auto AI Analysis was enabled)
Managing Runs
- Refresh: Click the refresh button to update run statuses
- Multiple Runs: You can start new runs while previous ones are still visible
- History: All past runs are preserved for comparison
Tips
- Name your runs with sprint numbers or dates for easy identification later
- Enable Auto AI Analysis for regression runs — the AI classification helps triage failures quickly
- Start with parallelism of 2-3 and increase if your tests don't conflict with each other
- Review results in Analysis after runs complete for trends and patterns
Related Topics
- Test Plan — Create and organize test plans before running
- Analysis — Review trends and patterns across multiple runs
- Actions — Get AI recommendations based on run results
- Automated Tests — Create the tests that runs execute