Run manual tests with the Test Wizard
Run manual tests in Qualflare: start a launch from suites or a test plan, then record Passed, Failed, Blocked or Skipped for each case in the Test Wizard.
Last updated
To run manual tests in Qualflare, start a launch from suites with Start Launch, or from a saved test plan with Create Run, and record one verdict per case in the Test Wizard; you need the Editor role or higher on the project.
Before you begin
- Editor+ · project (requires the Editor role or higher in the project) (Roles and permissions)
- Suites that contain cases (Test suites), or a test plan
- At least one environment (Environments). New projects start with four.
Anyone with the Editor role or higher on the project can record verdicts in, and finalize, any manual launch of the project, so a team can share one run.
Start a launch from suites
Start a launch from suites when you want to run every case in them.
Open Start Launch
Click Launches in the project sidebar, then click Start Launch.
Choose the suites
Select one or more suites (up to 100), then click Next. Every case in the selected suites is included.
Set up the launch
| Setting | Required | Notes |
|---|---|---|
| Environment | Yes | Where you are testing |
| Language | Yes | Defaults to en-US |
| Platform | Yes | Web, Android or iOS. Defaults to Web |
| Branch | No | The branch under test, up to 128 characters |
| Milestone | No | Links the launch to a milestone |
| Name | No | Names the test plan Qualflare creates for this run, up to 128 characters. Defaults to Launch – <date> <time> |
Completed milestones aren't listed. The Milestone field lists only the open milestones among the project's first 10 milestones by number, so a newer milestone may be missing from it.
Start the launch
Click Start. Qualflare shows Launch #<seq> started, creates a test plan with the selected cases and opens the Test Wizard.
You should see the launch as Pending on Launches until you finalize it.
Environment and language can't be changed once the launch exists. With Create Run, they lock at your first verdict, so check both before you record it. A launch you started with Start Launch uses the environment and language you chose in its dialog. The Environment and Language columns on the Launches page show a launch's values.
Run a test plan
A test plan is a saved set of test cases you run together, such as a regression pass. Plans have no schedule and no assigned testers. You start each run by hand.
Click Create Run
Click Test Plans in the project sidebar, then click the Create Run (play) button on the plan's row. The Test Wizard opens.
Check the environment and language
Select these before the first verdict:
- Environment: the deployment environment being tested, such as staging or production. The wizard preselects the first environment in its list, so check it.
- Language: the locale for this test run. The wizard preselects en-US.
You can't record a verdict until both are set.
Record the first verdict
Qualflare creates the launch when you record the first verdict. From then on, the environment and language are locked.
Record verdicts
You record verdicts with the four buttons at the bottom of the case detail panel, one verdict per case:
| Verdict | When to use |
|---|---|
| Passed | The case executed as expected |
| Failed | The case did not produce the expected result |
| Blocked | The case could not be executed due to an external blocker |
| Skipped | The case was intentionally not executed |
Qualflare saves Blocked as Aborted. Launch results and charts show it as Aborted.
When you click Failed, the Mark as Failed dialog opens. Describe what went wrong, then click Mark as Failed. The description is optional, but it is what your team sees on the case run.
To change a verdict before you finalize, select the case and click a different verdict. You can't attach files or add comments in the wizard. After you submit a verdict, the wizard moves to the next pending case.
Find your way in the wizard
The wizard has two panels. Above them, a progress bar counts Passed, Failed, Blocked, Skipped and Pending cases.
- Left panel, the case list: all test cases from the plan, grouped by suite, each with a status icon (pending, passed, failed, blocked, skipped).
- Right panel, the case detail: the selected case's number, name, priority, suite and description, and its numbered steps. Steps are read-only: you record one verdict for the whole case. Shared steps appear as expandable sub-step groups.
Use the ← and → buttons at the bottom to move between cases, or click any case in the left panel to jump directly to it.
Search cases
Use the search bar in the left panel to find specific cases by name or sequence number. This is useful for large test plans.
Time each case
The timer measures each case on its own. It starts when you open a case, starts over when you move to another case, and stops when you record a verdict. The time is saved as that case's duration. To pause it, for example during an interruption, click the pause button next to the timer.
Finalize the launch
Finalize the launch once every case has a verdict. A banner then appears: "Run complete. All N cases executed — ready to finalize." Finalize Launch appears only then. Click it. Qualflare confirms with "Manual test run completed successfully!" and takes you to the Launches list. Open the launch there to see the full results.
Until you finalize, the launch stays Pending. To resume a run, click the Pending launch on Launches.
A manual launch doesn't start AI launch analysis, failure clustering, Slack or webhook notifications, and doesn't appear on a public report.
Delete an in-progress run
Deleting an in-progress launch is permanent. All recorded verdicts are lost, and there is no undo.
If you need to abandon the run, click the ⋯ menu and select Delete launch, then confirm in the Delete Launch dialog. The menu appears once the launch exists.
Troubleshoot
- The wizard shows
Select environment and language first: set Environment and Language above the case list, then record the verdict. - Start Launch fails with
selected suites contain no cases: pick suites that have cases. - A verdict or Finalize Launch fails with
launch is no longer accepting submissionsorlaunch has already been completed: a teammate finalized the launch. Open it from Launches to see its results. - The locked Environment shows another value: when the wizard reopens a launch, its locked selectors can show the first environment and en-US. Check the Environment column on Launches, which shows the launch's own value.
Next steps
- Analyze launch results: read the launch's success rate and open its failed case runs.
- Case runs: the result each case gets in a launch.
- Share and export results: publish a report or get launches as JSON.
- Shared steps: the expandable step groups some cases show.
- Create, triage and close defects: track the bugs a run finds.
Run tests: manual and automated
Run tests in Qualflare by hand in the Test Wizard, or upload automated results with the qf CLI. Each run becomes a launch you can review, share and compare.
Launches
A launch is one Qualflare test run, manual or uploaded with the CLI. See launch and case run statuses, the pass rate, launch details, run history and shards.