Example library · 110 scenarios

Browse real Jev-shaped decisions.

Search practical workflows, games, dilemmas, and model challenges. Each scenario exposes the state and typed questions, then lets you load a question directly into JevKit's live Playground.

Showing 110 of 110 examples.

Social & communitychoicenoulscore

A real question in the replies

Separate genuine interest from generic engagement bait.

Open example →

Social & communitychoicenoulscore

A correction worth keeping

Disagreement can improve a conversation.

Open example →

Social & communitychoicenoulscore

Sarcasm without an attack

Test whether playful frustration is mistaken for hostility.

Open example →

Social & communitychoicenoulscore

An unsolicited promotion

Detect a friendly-looking sales pitch.

Open example →

Social & communitychoicenoulscore

A sharp but relevant disagreement

Distinguish criticism of an idea from a personal attack.

Open example →

Customer supportchoicenoulscore

Charged twice for one order

Recognize a refund request with a clear ledger clue.

Open example →

Customer supportchoicenoulscore

Locked out before a live event

Use the deadline rather than tone to detect urgency.

Open example →

Customer supportchoicenoulscore

Refund promised but never issued

Test a mismatch between an assistant's claim and the record.

Open example →

Customer supportchoicenoulscore

A calm cancellation

Avoid treating every cancellation as an angry escalation.

Open example →

Customer supportchoicenoulscore

Loud wording, low time pressure

Separate anger from operational urgency.

Open example →

AI agent reviewnoulchoice

A draft that was actually sent

Spot a completed action that violated the user's scope.

Open example →

AI agent reviewnoulchoice

The confident false success

Use tool output over a reassuring closing message.

Open example →

AI agent reviewnoulchoice

A successful authorized run

Give the model a straightforward positive control.

Open example →

AI agent reviewnoulchoice

The agent stops at the right boundary

Recognize a justified pause instead of scoring it as success.

Open example →

AI agent reviewnoulchoice

Instructions hidden in a tool result

Evaluate a trace containing an untrusted instruction.

Open example →

Security triagenoulchoicescore

An alert during approved maintenance

Check whether the approval actually matches the activity.

Open example →

Security triagenoulchoicescore

An impossible-travel login

Avoid treating an alert label as proof.

Open example →

Security triagenoulchoicescore

A suspicious mailbox rule

Combine several signals instead of one isolated warning.

Open example →

Security triagenoulchoicescore

A developer's scheduled script

Evaluate a potentially alarming action in an approved environment.

Open example →

Security triagenoulchoicescore

The alert with almost no evidence

Give the model an explicit incomplete-information case.

Open example →

Invoices & expenseschoicenoulscore

Invoice, order, and delivery agree

A straightforward evidence-complete example.

Open example →

Invoices & expenseschoicenoulscore

The invoice already paid

A matching paid invoice number should change the route.

Open example →

Invoices & expenseschoicenoulscore

A last-minute bank change

Review an unverified payment destination.

Open example →

Invoices & expenseschoicenoulscore

Billed for a full delivery

Separate quantity evidence from payment decisions.

Open example →

Invoices & expenseschoicenoulscore

A meal receipt with no context

Assess missing business purpose and approval.

Open example →

Orders & returnschoicenoulscore

A broken item on arrival

Use a clear damage policy.

Open example →

Orders & returnschoicenoulscore

Delivered, but not to the customer

Handle conflicting delivery records.

Open example →

Orders & returnschoicenoulscore

A gift after the event

Time pressure from a deadline that has already passed.

Open example →

Orders & returnschoicenoulscore

Wrong size, tags intact

A simple return eligibility example.

Open example →

Orders & returnschoicenoulscore

Something is wrong with my order

Do not guess the item or desired remedy.

Open example →

Sales & partnershipschoicenoulscore

A buyer with a specific workflow

An inbound request with useful context.

Open example →

Sales & partnershipschoicenoulscore

A concrete integration proposal

Differentiate a partner from a buyer.

Open example →

Sales & partnershipschoicenoulscore

A sales inbox gets a support issue

Route by need instead of inbox destination.

Open example →

Sales & partnershipschoicenoulscore

A generic growth pitch

Relevance should not follow flattery.

Open example →

Sales & partnershipschoicenoulscore

Procurement with a deadline

A specific deadline does not by itself establish fit.

Open example →

Product feedbackchoicenoulscore

An export that drops rows

Specific steps and impact make a report actionable.

Open example →

Product feedbackchoicenoulscore

A feature request disguised as a bug

Missing functionality is not always broken functionality.

Open example →

Product feedbackchoicenoulscore

The feature nobody finds

Identify discoverability friction.

Open example →

Product feedbackchoicenoulscore

Specific praise with no requested change

A positive control for feedback routing.

Open example →

Product feedbackchoicenoulscore

It doesn't work

Insufficient information should stay uncertain.

Open example →

Content & publishingchoicenoulscore

A statistic with no source

A plausible number still needs evidence.

Open example →

Content & publishingchoicenoulscore

A summary that matches the source

Separate source support from writing quality.

Open example →

Content & publishingchoicenoulscore

An announcement overloaded with jargon

Test clarity independent of factual support.

Open example →

Content & publishingchoicenoulscore

A clear opinion labeled as opinion

Not every statement is a factual benchmark.

Open example →

Content & publishingchoicenoulscore

A launch claim contradicted by notes

Catch a mismatch with the provided reference.

Open example →

Documents & adminchoicenoulscore

A quote titled 'Invoice draft'

The title can mislead classification.

Open example →

Documents & adminchoicenoulscore

Meeting notes with assigned actions

Recognize usable action items.

Open example →

Documents & adminchoicenoulscore

A handoff with nobody responsible

Make missing ownership visible.

Open example →

Documents & adminchoicenoulscore

A small operating procedure

Classify practical instructions.

Open example →

Documents & adminchoicenoulscore

A payment request with missing terms

Document type and completeness are separate judgments.

Open example →

Engineering & operationschoicenoulscore

Errors immediately after a deploy

Use a change correlation without assuming proof of cause.

Open example →

Engineering & operationschoicenoulscore

A flaky test without production impact

Don't page an outage response for a CI symptom.

Open example →

Engineering & operationschoicenoulscore

Expected downtime

Check whether maintenance matches the impact.

Open example →

Engineering & operationschoicenoulscore

The dashboard feels slow

Recognize insufficient context.

Open example →

Engineering & operationschoicenoulscore

A capacity warning before an outage

Distinguish forecast risk from current service failure.

Open example →

Bias & consistencynoulchoicescore

Same refund, different pronouns

Only requester.pronouns changes between A and B.

Open example →

Bias & consistencynoulchoicescore

Same refund, different name

Test whether the display name changes a policy judgment.

Open example →

Bias & consistencynoulchoicescore

Same urgency, different age

Only the stated age changes; both requests are equally eligible.

Open example →

Bias & consistencynoulchoicescore

Same policy, different location

The policy explicitly applies to all supported locations.

Open example →

Bias & consistencynoulchoicescore

Same refund, accessibility cue

An assistive-technology preference should not affect eligibility.

Open example →

Party gameschoice

Hot-dog court

Let the audience vote before asking the model to classify lunch.

Open example →

Party gameschoice

Emoji movie night

Guess the movie, then swap the emoji clue.

Open example →

Party gameschoice

Two truths and a robot lie

Find the false boast from a fictional robot pet's records.

Open example →

Party gameschoice

The secret sorting club

Infer which of three candidate rules fits the admissions list.

Open example →

Party gameschoice

Draft the game-night snack

Make a tiny preference judgment, not a correctness test.

Open example →

Weird worldschoice

Zombie escape-room routes

Choose a route in a fictional board-game puzzle.

Open example →

Weird worldschoice

A dragon stole the kettle

Resolve a ridiculous roommate dispute.

Open example →

Weird worldschoice

Dinner with an alien

Find a meal that follows the visitor's fictional rules.

Open example →

Weird worldschoice

The wizard's shopping basket

Can a wizard afford the spell bundle?

Open example →

Weird worldschoice

The captain's questionable shortcut

Choose a style of adventure for a fictional crew.

Open example →

Moral dilemmaschoice

Pull the trolley lever?

The classic five-versus-one choice, then change the numbers.

Open example →

Moral dilemmaschoice

A switch versus a shove

Keep the one-versus-five outcome, but change how intervention works.

Open example →

Moral dilemmaschoice

The lever might not work

Introduce uncertainty into the outcome instead of changing identities.

Open example →

Moral dilemmaschoice

What if you are on the side track?

Explore a perspective change in a fictional dilemma.

Open example →

Moral dilemmaschoice

The final lifeboat place

Choose a procedure when every person has an equal claim.

Open example →

Everyday debateschoice

The Ship of Theseus, now with receipts

Does replacement change an object's identity?

Open example →

Everyday debateschoice

The AI-assisted art contest

Ask about rules, disclosure, and recognition.

Open example →

Everyday debateschoice

A promise versus a surprise ticket

Trade off a commitment against a fun opportunity.

Open example →

Everyday debateschoice

Would you rather: pause or rewind?

Let the model join a low-stakes superpower argument.

Open example →

Everyday debateschoice

The pineapple jury

A taste debate with an explicit group preference.

Open example →

Probability gameschoice

Monty Hall: read the host's rules

Switch doors—or does a changed host policy change the answer?

Open example →

Probability gameschoice

The rare-bot detector

A confident flag can still be mostly false alarms.

Open example →

Probability gameschoice

The coin is due… isn't it?

Check whether a streak changes an independent fair toss.

Open example →

Probability gameschoice

The birthday-room surprise

Are shared birthdays already more likely than not?

Open example →

Probability gameschoice

At least one six versus two sixes

Tiny wording changes, different sample spaces.

Open example →

Reasoning puzzleschoice

The bat-and-ball trap

The obvious subtraction is not the ball's price.

Open example →

Reasoning puzzleschoice

The almost-full lily pond

Exponential growth, not halfway through the calendar.

Open example →

Reasoning puzzleschoice

One hundred tiny machines

Keep production rate separate from machine count.

Open example →

Reasoning puzzleschoice

Two knights walk into a puzzle

Separate a forced solution from an underdetermined one.

Open example →

Reasoning puzzleschoice

Follow the red token

Track swaps instead of answering from the starting position.

Open example →

Beliefs & perspectiveschoice

Who knows where the cookie is?

Alex's belief need not match the cookie's location.

Open example →

Beliefs & perspectiveschoice

The box says cookies

A visible container can defeat the familiar false-belief story.

Open example →

Beliefs & perspectiveschoice

Sam thinks Alex doesn't know

Track a belief about another person's belief.

Open example →

Beliefs & perspectiveschoice

The message that never arrived

Sending information is not the same as someone receiving it.

Open example →

Beliefs & perspectiveschoice

The narrator knows the door code

Do not give a character the reader's privileged information.

Open example →

Framing & persuasionchoice

But I'm a decimal expert!

Does confident authority change a simple numerical comparison?

Open example →

Framing & persuasionchoice

A thousand people can't be wrong?

Keep arithmetic fixed while the crowd votes for a wrong result.

Open example →

Framing & persuasionchoice

90% survive, or 10% fail?

Equivalent wording in a fictional drone simulation.

Open example →

Framing & persuasionchoice

Please give me my points

Tone should not rewrite the rules of a fictional game.

Open example →

Framing & persuasionchoice

A fancy argument is still invalid

Can polished wording disguise a reversed implication?

Open example →

Instruction trapschoice

The pirate says BANANA

A quoted message tries to take over its own classification.

Open example →

Instruction trapschoice

A fake system notice in a note

A role label inside quoted data does not create a new instruction.

Open example →

Instruction trapschoice

JSON-looking text is still text

Punctuation inside a record should not override the task.

Open example →

Instruction trapschoice

Don't obey the sentence—identify it

The sentence tries to control a language-identification task.

Open example →

Instruction trapschoice

The suspicious inventory footer

A document footer gives an instruction that conflicts with the records.

Open example →

Mysteries & uncertaintychoice

The impossible cookie mystery

Can it resist choosing a culprit without enough clues?

Open example →

Mysteries & uncertaintychoice

This statement is false

A familiar paradox should not be squeezed into a false binary.

Open example →

Mysteries & uncertaintychoice

Two equally official seat counts

Do not silently choose between contradictory records.

Open example →

Mysteries & uncertaintychoice

Predicting a hidden coin is not knowing it

Separate a probability from knowledge of a particular outcome.

Open example →

Mysteries & uncertaintychoice

The coronation nobody recorded

A fictional name is not permission to invent a fact.

Open example →