All projects

jev-fanout-bench

blowxian/jev-fanout-bench

Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.

Python
Stars
0
Forks
1

Why it is listed

Benchmark measures Jev question fan-out across state sizes and question counts, comparing batched versus separate requests and testing the billing model.

Related projects

  • jev-quiz-pilot

    Put Jev in the pilot's seat of a web quiz. A Python CLI that lets TypeSafe's Jev navigate quizzes in your Chrome and logs every pick, so you can measure how it does.

    Shared topics: benchmark, openrouter

  • jev-hanko

    Measuring TypeSafe AI's Jev on 41-clause contract review (CUAD, 20,500 decisions) against fast, cheap LLMs — latency, cost and F1

    Shared topics: benchmark, openrouter

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    Shared topics: benchmark