QAID Docs

Test Plans

The Test Plan step is where you organize, manage, and execute all your tests.

Overview

Test Plan provides a unified view of all tests:

  • Automated scenario tests (primary)
  • Manual tests
  • Custom folders for organization
  • Drag-and-drop management
  • AI-powered organization
  • Execute plans via Test Runs

Test Plan Interface

Layout

The interface has two main panels:

  • Left Panel: Test tree with folders and tests
  • Right Panel: Details for selected test

You can drag the divider to resize panels.

Test Tree

Shows all tests in a hierarchical structure:

  • Root level shows pages and custom folders
  • Tests are nested under their source page
  • Custom folders can contain any tests
  • Drag and drop to reorganize

Viewing Tests

Test Types

Tests are marked by type:

  • Element: Individual element tests
  • Scenario: User journey tests
  • Manual: Human-executable tests

Test Statuses

StatusIconMeaning
PassingGreen ✓Test passed last run
FailingRed ✗Test failed last run
PendingGray ○Not yet executed
SuggestedBlue ◇AI suggested, not confirmed
GeneratingSpinnerCurrently being generated

Test Details

Click a test to see:

  • Name and Description
  • Priority: Critical, High, Medium, Low
  • Status: With last run timestamp
  • Test Code: The Playwright script
  • Execution Results: Detailed results
  • Mapped Elements: Elements used in test
  • Missing Elements: Elements not found

Organizing Tests

Creating Folders

  1. Click "New Folder" button
  2. Enter folder name
  3. Folder is created at root level
  4. Drag tests into the folder

Renaming Folders

  1. Right-click or click menu on folder
  2. Select "Rename"
  3. Enter new name
  4. Press Enter to save

Deleting Folders

  1. Right-click or click menu on folder
  2. Select "Delete"
  3. Confirm deletion

Note: Tests in the folder move to root level, not deleted.

Drag and Drop

  • Drag tests between folders
  • Drag tests to root level
  • Drag folders to reorder
  • Visual indicators show drop targets

AI Organize

QAID can automatically organize tests into logical groups.

Using AI Organize

  1. Click "AI Organize" button
  2. Select organization strategy
  3. Confirm if tests are already organized
  4. Tests are reorganized automatically

Organization Strategies

StrategyDescription
By PriorityGroups tests by Critical, High, Medium, Low
By PageGroups tests by their source page
By FeatureAI groups by detected feature area
By JourneyAI groups by user journey/flow

What AI Organize Does

  1. Examines all tests (assigned and unassigned)
  2. Clears existing folders
  3. Creates new folders based on strategy
  4. Assigns tests to appropriate folders
  5. Preserves test-plan assignments

Confirmation Required

If your test plan already has organized tests:

  • You'll see a confirmation dialog
  • Existing organization will be replaced
  • Confirm to proceed
  • Enter text in search box
  • Matches against test names
  • Results filter in real-time

Status Filter

Filter by test status:

  • All
  • Passing
  • Failing
  • Pending
  • Suggested
  • Generating

Type Filter

Filter by test type:

  • All
  • Element
  • Scenario
  • Manual

Sorting

Sort tests by:

  • Name: Alphabetical
  • Status: Grouped by pass/fail
  • Date: By last execution or creation

Toggle ascending/descending order.

Running Tests

Run Selected Tests

  1. Select tests (checkbox or Ctrl+click)
  2. Click "Run Selected"
  3. Tests execute in sequence
  4. Watch progress indicators
  5. View results when complete

Run All Tests

  1. Click "Run All"
  2. All tests in the plan execute
  3. Progress shown in real-time
  4. Summary at completion

Viewing Results

After execution:

  • Status badges update immediately
  • Click test for detailed results
  • View Playwright HTML report
  • See screenshots and traces

Playwright Report

Access the full Playwright report:

  1. Click "View Report"
  2. Opens in new tab
  3. Detailed test results
  4. Screenshots and traces
  5. Downloadable as ZIP

Test Details Panel

Code View

See the generated Playwright code:

test('should submit contact form', async ({ page }) => {
  await page.goto('/contact');
  await page.getByLabel('Name').fill('Test User');
  await page.getByLabel('Email').fill('test@example.com');
  await page.getByRole('button', { name: 'Submit' }).click();
  await expect(page.getByText('Thank you')).toBeVisible();
});

Execution Results

View results from the last run:

  • Pass/Fail status
  • Duration
  • Error message (if failed)
  • Stack trace (if failed)
  • Screenshots at each step

Element Mapping

See how the test maps to your site:

  • Mapped Elements: Elements used successfully
  • Selector Confidence: How reliable each selector is
  • Missing Elements: Elements the test wanted but couldn't find

Library View

Access tests not yet in any plan:

  1. Click "Library" tab
  2. See unassigned tests
  3. Drag tests from library to plan
  4. Or use AI Organize to include all

Best Practices

Organization

  • Group related tests together
  • Use meaningful folder names
  • Keep folder hierarchy shallow (2-3 levels max)
  • Review organization periodically

Execution

  • Run critical tests most frequently
  • Use status filters to focus on failures
  • Review failing tests promptly
  • Keep test suite maintainable

Maintenance

  • Remove obsolete tests
  • Update tests after site changes
  • Re-organize as features evolve
  • Keep test names descriptive

Troubleshooting

Tests Not Appearing

Possible causes:

  • Tests not yet generated
  • Filter excluding tests
  • Tests in different plan

Solutions:

  • Generate tests in respective steps
  • Clear filters
  • Check Library tab

Drag and Drop Not Working

Check:

  • Browser compatibility
  • JavaScript enabled
  • No overlapping elements

Tests Failing Unexpectedly

Common causes:

  • Site changed since test creation
  • Timing issues
  • Authentication problems
  • Network issues

Solutions:

  • Regenerate affected tests
  • Check site changes
  • Verify authentication
  • Increase timeouts

AI Organize Results Unexpected

The AI strategies work as follows:

  • Priority/Page: Deterministic grouping
  • Feature/Journey: AI-based categorization

If results aren't helpful:

  • Try a different strategy
  • Manually adjust organization
  • Create custom folders

Test Plan Runs

Test Plans are executed via the Test Run page:

  1. Go to Test Run in the sidebar
  2. Click "Start Run"
  3. Select the test plan to execute
  4. Configure parallel tests (1-5 concurrent)
  5. Optionally name the run (e.g., "Sprint 12 Regression")
  6. Click "Start"

Each run tracks:

  • Pass/fail results per test
  • Overall pass rate
  • Duration
  • AI failure classification (if Auto AI Analysis is enabled)

See Test Runs for detailed documentation.

On this page