jev-fanout-bench
blowxian/jev-fanout-bench
Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.
Python
- 星标
- 0
- 派生
- 1
收录依据
基准在不同状态大小和问题数量下测量 Jev 问题扇出,对比批量与分开请求并检查计费模型。
blowxian/jev-fanout-bench
Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.
基准在不同状态大小和问题数量下测量 Jev 问题扇出,对比批量与分开请求并检查计费模型。
Put Jev in the pilot's seat of a web quiz. A Python CLI that lets TypeSafe's Jev navigate quizzes in your Chrome and logs every pick, so you can measure how it does.
共同主题: benchmark, openrouter
Measuring TypeSafe AI's Jev on 41-clause contract review (CUAD, 20,500 decisions) against fast, cheap LLMs — latency, cost and F1
共同主题: benchmark, openrouter
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共同主题: benchmark