jev-calibration
themsquared/jev-calibration
Is TypeSafe AI's Jev calibrated? Reliability diagram, ECE and saturation split on 240 hand-labelled agent tool calls.
Python
- スター
- 0
- フォーク
- 0
掲載理由
掲載理由は準備中です
参照元を見る関連プロジェクト
- jev-capability-atlas
Independent, evidence-based map of when TypeSafe's Jev actually holds up vs. breaks down — real API-call receipts, not a leaderboard. 中文為主的雙語 repo。
共通トピック: ai-agents, benchmark, calibration
- typed-decision-bench
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共通トピック: benchmark, calibration
- snake-arena-jev-vs-llms
How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.
共通トピック: benchmark, calibration