jevals-data
Jevals/jevals-data
Independent benchmark data for TypeSafe's Jev (System One model) vs LLMs: accuracy, calibration, cost. Boards + per-decision logs, CC-BY-4.0
- 星标
- 1
- 派生
- 2
收录依据
该项目发布 Jev 及同类模型在 Noul、Choice、Score 任务上的独立基准数据。
Jevals/jevals-data
Independent benchmark data for TypeSafe's Jev (System One model) vs LLMs: accuracy, calibration, cost. Boards + per-decision logs, CC-BY-4.0
该项目发布 Jev 及同类模型在 Noul、Choice、Score 任务上的独立基准数据。
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共同主题: benchmark, calibration, llm-evaluation
Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.
共同主题: benchmark, calibration, llm-evaluation
Jev vs GPT-4.1 as synthetic survey respondents on Twin-2K-500. How you ask mattered more than which model you used.
共同主题: benchmark, calibration, llm-evaluation