全部项目

jev-decision-bench

Tenkei/jev-decision-bench

A reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.

Python
星标
3
派生
0

收录依据

在 TypeSafe Jev 风格有界决策任务上评估普通语言模型的框架,非通用文本生成榜单,也非托管 Jev 性能证明。

相关项目

  • jev-bench

    Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost

    共同主题: anthropic, benchmark, evals

  • snake-arena-jev-vs-llms

    How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.

    共同主题: anthropic, benchmark

  • jev-healthcare-lab

    Jev vs DeepSeek 医疗任务对比:12 类场景、96 项测试,效果、耗时与费用一览。 | Jev vs DeepSeek on 96 healthcare tasks across 12 scenarios: quality, latency, cost and open experiment data.

    共同主题: benchmark, deepseek