全部项目

jev-bench

Running-Dolphins/jev-bench

Measure accuracy and calibration of Jev (TypeSafe AI's decision model) on public datasets: 12 business-like tasks, 7 experiments, one Python file.

Python
星标
0
派生
0

收录依据

jev-bench 是基于公开数据集的独立准确率/校准基准;README 强调置信度表现会随任务而变化。

相关项目

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共同主题: benchmark, calibration

  • snake-arena-jev-vs-llms

    How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.

    共同主题: benchmark, calibration

  • jev-sim

    Jev-compatible /v1/systemone server reading typed decisions from LLM logits, benchmarked against TypeSafe's Jev on the same items via JevBench

    共同主题: benchmark, calibration