All projects

jev-decision-bench

Tenkei/jev-decision-bench

A reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.

Python
Stars
3
Forks
0

Why it is listed

An evaluation harness for conventional language models on TypeSafe Jev-style bounded-decision tasks, not a general text-generation leaderboard or proof of hosted Jev performance.

Related projects

  • jev-bench

    Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost

    Shared topics: anthropic, benchmark, evals

  • snake-arena-jev-vs-llms

    How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.

    Shared topics: anthropic, benchmark

  • jev-healthcare-lab

    Jev vs DeepSeek 医疗任务对比:12 类场景、96 项测试,效果、耗时与费用一览。 | Jev vs DeepSeek on 96 healthcare tasks across 12 scenarios: quality, latency, cost and open experiment data.

    Shared topics: benchmark, deepseek