すべてのプロジェクト

jev-decision-bench

Tenkei/jev-decision-bench

A reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.

Python
スター
3
フォーク
0

掲載理由

TypeSafe Jev 型の限定判断タスクで通常の言語モデルを評価する基盤。一般的な生成文ランキングやホスト Jev の性能証明ではない。

関連プロジェクト

  • jev-bench

    Benchmark TypeSafe's Jev (System One model) vs Claude on structured decisions: accuracy, latency, calibration, cost

    共通トピック: anthropic, benchmark, evals

  • snake-arena-jev-vs-llms

    How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.

    共通トピック: anthropic, benchmark

  • jev-healthcare-lab

    Jev vs DeepSeek 医疗任务对比:12 类场景、96 项测试,效果、耗时与费用一览。 | Jev vs DeepSeek on 96 healthcare tasks across 12 scenarios: quality, latency, cost and open experiment data.

    共通トピック: benchmark, deepseek