jev-bench
stern9/jev-bench
Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost
Python
- 星标
- 0
- 派生
- 0
收录依据
暂无收录依据
查看引用来源stern9/jev-bench
Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost
暂无收录依据
查看引用来源A reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.
共同主题: anthropic, benchmark, evals
How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.
共同主题: anthropic, benchmark
What can Jev actually do? Reproducible experiments and research reports exploring its capabilities and limits.
共同主题: benchmark, evals