jev-calibration
themsquared/jev-calibration
Is TypeSafe AI's Jev calibrated? Reliability diagram, ECE and saturation split on 240 hand-labelled agent tool calls.
Python
- 星标
- 0
- 派生
- 0
收录依据
暂无收录依据
查看引用来源相关项目
- jev-capability-atlas
Independent, evidence-based map of when TypeSafe's Jev actually holds up vs. breaks down — real API-call receipts, not a leaderboard. 中文為主的雙語 repo。
共同主题: ai-agents, benchmark, calibration
- typed-decision-bench
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共同主题: benchmark, calibration
- snake-arena-jev-vs-llms
How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.
共同主题: benchmark, calibration