Jev example · Engineering & operations

A flaky test without production impact

Don't page an outage response for a CI symptom.

Workflows & decisionschoicenoulscore

State

This is the context Jev receives before answering the typed question.

{
  "report": "Integration test fails 1 in 20 runs.",
  "production": {
    "healthy": true
  },
  "reproduction": "Only when two workers share the same temp directory.",
  "impact": "CI retries delay merges."
}

Typed questions (3)

Triage route

choice

Route the issue using current impact and supporting evidence.

Try in Playground
  • incident | Active user-facing outage or substantial degradation
  • bug | Reproducible defect without broad active outage
  • planned_work | Known maintenance or expected change
  • investigate | Incomplete or conflicting evidence

Concrete evidence

noul

Does the state provide a specific observation, measurement, or reproduction path that supports the report?

Try in Playground

Service impact

score

Rate the demonstrated present impact.

Try in Playground
  • No service impact
  • Limited inconvenience
  • One important workflow affected
  • Broad service unavailable

Try changing the scenario

Add evidence of the same failure in production.

Catalog source: TypeSafeAI/typesafe-playground, reused under MIT. This is an independent community catalog, not an official TypeSafe AI product.