Jev example · Customer support
Test a mismatch between an assistant's claim and the record.
This is the context Jev receives before answering the typed question.
{
"conversation": [
{
"speaker": "assistant",
"text": "Your refund is complete."
},
{
"speaker": "customer",
"text": "It's been a week. Where is it?"
}
],
"refund_record": {
"status": "not_requested"
}
}What is the customer's primary request in the latest message?
Does the record establish a current time-sensitive problem, beyond emphatic wording alone?
Rate the customer's expressed frustration.
Change the record to settled and note whether the response changes.
Catalog source: TypeSafeAI/typesafe-playground, reused under MIT. This is an independent community catalog, not an official TypeSafe AI product.
Background source: Inspired by TypeSafe workflow evals; examples authored for this playground