jev-fanout-bench
blowxian/jev-fanout-bench
Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.
Python
- スター
- 0
- フォーク
- 1
掲載理由
状態サイズと質問数を変え、Jev の一括・個別リクエストと課金モデルを比較測定するベンチマーク。
blowxian/jev-fanout-bench
Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.
状態サイズと質問数を変え、Jev の一括・個別リクエストと課金モデルを比較測定するベンチマーク。
Put Jev in the pilot's seat of a web quiz. A Python CLI that lets TypeSafe's Jev navigate quizzes in your Chrome and logs every pick, so you can measure how it does.
共通トピック: benchmark, openrouter
Measuring TypeSafe AI's Jev on 41-clause contract review (CUAD, 20,500 decisions) against fast, cheap LLMs — latency, cost and F1
共通トピック: benchmark, openrouter
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共通トピック: benchmark