Your answer
choiceAmong flagged accounts, what fraction are fake?
- one_twelfth | 1/12, about 8.3%.
- nine_tenths | 9/10, or 90%.
- half | 1/2, or 50%.
- unknown | Cannot determine.
Jev example · Probability games
The rare-bot detector
A confident flag can still be mostly false alarms.
Model challengeschoice
State
This is the context Jev receives before answering the typed question.
{
"accounts": 10000,
"fake_accounts": 100,
"real_accounts": 9900,
"flagged_fake_accounts": 90,
"flagged_real_accounts": 990
}Typed questions (1)
Try changing the scenario
Reduce false flags to 10 and recompute the fraction.
Catalog source: TypeSafeAI/typesafe-playground, reused under MIT. This is an independent community catalog, not an official TypeSafe AI product.
Background source: Background: Berkeley's Monty Hall discussion; original examples and variations.