AI Insights
AI Insights in Qualflare flags flaky and redundant test cases after each uploaded launch. Review each recommendation, then accept or dismiss it.
Last updated
In Qualflare, AI Insights lists recommendations that flag flaky and redundant test cases in a project; Qualflare checks the cases of every launch you upload, and a recommendation never changes or deletes a case.
| Fact | Detail |
|---|---|
| Where | AI Insights under Analysis in the project sidebar |
| Plans | Core, Scale, Enterprise (available on Core, Scale, Enterprise). On other plans the page shows Upgrade to Unlock |
| Who | View: Viewer+ · project (requires the Viewer role or higher in the project). Accept and Dismiss: Editor+ · project (requires the Editor role or higher in the project) |
| Allowance | The redundancy check uses one AI case analysis per uploaded launch; see Limits and plan availability |
| Notifications | Flaky Case Insights and Redundant Case Insights in the project's Notifications settings (Insight notifications) |
How AI Insights works
AI Insights shows what Qualflare's case analysis finds in each launch you upload:
- Flaky: flaky detection checks each case's pass/fail history against the project's Quality settings and uses no AI, so it runs even with project AI off All plans (available on Starter, Core, Scale, Enterprise, Open Source). It also opens a flaky defect (How defects are created) and resolves it when the case recovers.
- Redundant: the redundancy check compares cases with AI. It needs project AI on and the monthly case analysis allowance.
- Low Value: Qualflare doesn't create Low Value recommendations on any plan, so the Low Value tab is empty.
On Starter and the Open Source plan, flaky detection still runs and opens flaky defects, but the AI Insights page shows Upgrade to Unlock, and no insight notification is sent.
Every 15 minutes, Qualflare sends project members one in-app notification per type for the new recommendations, while that insight notification is on (the default). A redundant-case notification has a one-time Create Defect button.
Recommendation types
Each AI Insights recommendation carries a confidence score and has one of three types:
| Type | What it flags | The detail dialog shows |
|---|---|---|
| Flaky | A pass/fail history that looks like flakiness, not a real regression | The Flakiness score |
| Low Value | None is created | Nothing |
| Redundant | Coverage another case already provides | The Similarity percentage and the Similar case, which opens that case |
Open AI Insights
The AI Insights page has All, Flaky, Low Value and Redundant tabs, and the last three show how many active recommendations they hold. Its columns are Case, Suite, Type, Confidence, Detected and Status; Confidence and Detected sort. It shows Active recommendations by default: use the Status filter for Accepted, Declined or Stale ones, or search by case name. A row's menu has View details, plus Accept and Dismiss on active rows.
Review a recommendation
To review an AI Insights recommendation, compare its evidence, then record your decision:
- Click a row, or choose View details from its menu, to open the detail dialog.
- Compare the evidence: the Flakiness score of a Flaky recommendation, or the Similar case of a Redundant one.
- Click Accept to record your decision, or Dismiss to keep the case as it is. Both need Editor+ · project (requires the Editor role or higher in the project); the app shows the buttons to Viewers too, but refuses their decision. You should see
Recommendation accepted.orRecommendation declined. - Change the case yourself, because AI Insights doesn't: archive or edit it in Browse. For a Redundant pair, keep one case and archive the other.
Recommendation lifecycle
A recommendation starts Active and moves to one of:
- Accepted: you clicked Accept. This records your decision only. Qualflare doesn't archive or edit the case, so do that yourself. An accepted recommendation turns Stale if the finding stops being true.
- Declined: you clicked Dismiss to keep the case as it is. Qualflare doesn't raise that recommendation again.
- Stale: the recommendation no longer applies, for example because the case's run history changed, or because the case (or the case it duplicates) was archived. Unarchiving the case doesn't restore it right away. The next analysis raises it again if it still applies.
Insights never change or delete a test case. You decide with Accept or Dismiss, and a recommendation can also turn Stale on its own.
Limits and plan availability
Plans with AI Insights Core, Scale, Enterprise (available on Core, Scale, Enterprise) include these AI case analyses per month: Core 1,000, Scale 4,000, Enterprise 200,000.
When the allowance is used up, the redundancy check is skipped for new launches until the monthly reset, and flaky detection continues. AI Insights comes with the plan, not a setting an admin switches on, and every project shows it in the sidebar. See AI usage limits.
Related
- Guides: Failure Clusters · Create, triage and close defects
- Reference: Quality settings · Glossary: Flaky test · AI Features settings and limits
- CLI/API: MCP server reference. AI Insights has no CLI command or MCP tool
AI in Qualflare
Qualflare's AI features: AI Insights, Failure Clusters, AI Launch Analysis, Quo and the AI filter, with the project AI switch and per-plan usage limits.
Failure Clusters
Qualflare groups similar failures from uploaded launches into failure clusters, labels each at 5 failures and opens a defect. Review, merge and export them.