jev-bench
stern9/jev-bench
Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost
Python
- Stars
- 0
- Forks
- 0
Why it is listed
No inclusion rationale available yet
View cited sourcestern9/jev-bench
Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost
No inclusion rationale available yet
View cited sourceA reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.
Shared topics: anthropic, benchmark, evals
How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.
Shared topics: anthropic, benchmark
What can Jev actually do? Reproducible experiments and research reports exploring its capabilities and limits.
Shared topics: benchmark, evals