This recorded test compares real Jev scores with human answers.
Support triage
Decide which customer messages need a prompt human response.
An outage waits, or a feature request pages someone.
Does this support message describe an urgent, unresolved problem requiring prompt human attention, such as an outage, duplicate charge, account lockout, or security exposure?
An urgent, unresolved problem needs a person now.
A routine question, suggestion, or resolved issue can wait.
Where did Jev disagree?
Compare Jev’s recorded answers with these 20 human labels. Moving the line only explores the tradeoff on this set. It is not a holdout.
Recorded September 27, 2026. Opening it makes no new model call.Examples behind the result
These human labels stay fixed while you explore the score and decision line.
YES examples
Checkout has returned a 500 error for every customer since 9:10. We cannot accept orders.
Our September invoice charged the Pro plan twice. Please reverse the duplicate charge.
All admins are locked out after the SSO change, so we cannot manage our account.
A public link appears to expose another customer's private export. Please investigate immediately.
NO examples
Could you add a dark theme sometime this year?
Where can I find the documentation for CSV imports?
The login issue from yesterday is fixed now. Thanks for the help.
I like the new dashboard layout, especially the filters.