Skip to content

Query your app's memory in plain English.

testrelic "why did checkout fail?"

Every test run becomes shared context for Cursor, Claude Code, Copilot, and Codex — over MCP. So your whole team ships at senior-IC speed, not just the engineer who's been here longest.

Used every day by teams shipping software with AI
Purple Plum FI
ClubQ
Virtu
Levich

How Ask AI works

Three steps from question to artifact

No dashboards to configure, no filters to set.

You ask in natural language

Type a question or request the way you'd say it to a colleague. No special syntax, no query language.

platform.testrelic.ai/ai
@shop-e2e@checkout.spec.ts
What's the flake rate on checkout this month?
which tests broke after the last deploy?
Ask about your test runs…

No query language. No filters to set.

AI reads your test data

Your prompt is mapped to live test runs, failure logs, coverage metrics and historical trends — every number sourced, none invented.

platform.testrelic.ai/ai
what's the flakiest suite this week?
tr_recent_runs30 runs indexed
tr_flaky_audit4/30 · checkout.spec.ts
tr_project_trends12 weeks of history

Reading your live runs — every number is sourced, none invented.

Prompts and outputs are never used to train shared models.

You get a shareable artifact

A dashboard, plan, report or deck, rendered from your actual data — and shareable straight back into Slack or Teams.

platform.testrelic.ai/ai
Test health · this month

Flake rate

13.3%+9.1

MTTR

4.2h−38%

Pass rate

96.1%−1.4

W1
W2
W3
W4
rendered live — not a templateshare

Where your team works

The same grounded answers, in Slack and Teams

No context-switching — ask from the channel you're already in.

Slash commands in Slack

Type /testrelic anywhere your team works. Answers thread under your message with charts and deep links, scheduled QA digests pin to any channel, and any Ask AI artifact shares back in one click.

acme

Channels

# eng-quality

# releases

# incidents

Apps

TestRelic

# eng-quality

dana10:42

/testrelic why did checkout fail?

TestRelicApp10:42

checkout.spec.ts · 4/30 failing

[data-test=pay-now] was renamed in v2.4.1 — all failures are post-deploy, not timing.

Open runHeal test
✅ 3🙌 2

Weekly QA digest pinned · Mondays 9:00

Adaptive Cards & Tabs in Teams

@mention the TestRelic bot for an instant Adaptive Card with drill-down buttons, pin a live QA dashboard as a channel Tab, and get regression and flaky-spike alerts in the activity feed.

Quality › General

Sarah9:14 AM

@TestRelic flake rate this sprint?

TestRelic · Quality digest

Flake rate

13.3% ▲ +9.1

MTTR

4.2h ▼ −38%

Pass rate

96.1%

Drill downPin as Tab

Regression and flaky-spike alerts in the activity feed.

What you can generate

Every artifact is rendered live from your test data

Not templates — your actual runs.

Dashboards, reports and decks

Ask for a test-health dashboard, a weekly QA summary, or a sprint-review deck. Pass rates, MTTR, flaky trends, P0 escapes, coverage tables — populated from your real runs and formatted to send.

platform.testrelic.ai/ai/artifacts
Sprint QA report · shop-e2e

Pass rate

96.1%−1.4

P0 escapes

0

Flake rate

13.3%+9.1

MTTR

4.2h−38%

Failures by week

W1
W2
W3
W4

Top offenders

checkout.spec.ts4 fails
cart.spec.ts1 fail
login.test.js0 fails

Also renders as a live dashboard or a stakeholder deck — same data, formatted for the audience.

Test plans and path maps

Describe a feature and get a structured regression plan with prioritized cases, coverage gaps and edge cases. Describe a journey and get a visual map of the critical paths through it.

platform.testrelic.ai/ai/artifacts
Regression plan · checkout

Cases

14

Coverage gaps

2

Prioritized cases

P0 pays with saved cardcovered
P0 guest checkoutgap
P1 3DS challengegap
P1 expired card declinecovered
P2 saved-address reusecovered

Test path map

cartaddresspayreceipt

6 edge cases suggested from the runs behind this flow.

Plain English queries

Ask anything — which tests broke after last deploy, what's the flakiest suite this week. No SQL, no filters, just answers grounded in your runs.

platform.testrelic.ai/ai
which tests broke after v2.4.1?
tr_compare_runs#4820 → #4821
tr_search_failures3 specs affected
checkout.spec.ts4 fails · post-deploy
cart.spec.ts1 fail
login.test.jspassing

All three trace to [data-test=pay-now], renamed in v2.4.1.

Ask a follow-up…

No SQL, no filters — grounded in 30 runs.

Start asking questions, get real answers.

Ask AI is included in the Growth plan. Start your 14-day free trial — no credit card required. Prompts and outputs are never used to train shared models; enterprise deployments support bring-your-own LLM (BYOL) for full data isolation.