すべてのプロジェクト

jev-fanout-bench

blowxian/jev-fanout-bench

Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.

Python
スター
0
フォーク
1

掲載理由

状態サイズと質問数を変え、Jev の一括・個別リクエストと課金モデルを比較測定するベンチマーク。

関連プロジェクト

  • jev-quiz-pilot

    Put Jev in the pilot's seat of a web quiz. A Python CLI that lets TypeSafe's Jev navigate quizzes in your Chrome and logs every pick, so you can measure how it does.

    共通トピック: benchmark, openrouter

  • jev-hanko

    Measuring TypeSafe AI's Jev on 41-clause contract review (CUAD, 20,500 decisions) against fast, cheap LLMs — latency, cost and F1

    共通トピック: benchmark, openrouter

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共通トピック: benchmark