jev-bench
stern9/jev-bench
Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost
Python
- スター
- 0
- フォーク
- 0
掲載理由
掲載理由は準備中です
参照元を見るstern9/jev-bench
Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost
掲載理由は準備中です
参照元を見るA reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.
共通トピック: anthropic, benchmark, evals
How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.
共通トピック: anthropic, benchmark
What can Jev actually do? Reproducible experiments and research reports exploring its capabilities and limits.
共通トピック: benchmark, evals