すべてのプロジェクト

snake-arena-jev-vs-llms

angelgalvisc/snake-arena-jev-vs-llms

How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.

Python
スター
0
フォーク
0

掲載理由

READMEが説明する1分間のSnakeベンチマークで、Jevと6種類の汎用LLMを同じ小さな判断課題で比較します。結果は本レビューで再現していません。

関連プロジェクト

  • decision-models-lab

    Learn decision models by building with them. TypeSafe Jev and Microsoft Decision-1 route support tickets in under a second for about $0.02 per 1,000 calls; Claude handles the hard cases. Interactive site, benchmark, calibration tests and docs.

    共通トピック: anthropic, benchmark, calibration

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共通トピック: benchmark, calibration

  • jev-sim

    Jev-compatible /v1/systemone server reading typed decisions from LLM logits, benchmarked against TypeSafe's Jev on the same items via JevBench

    共通トピック: benchmark, calibration