すべてのプロジェクト

jev-orderby-bench

yodablocks/jev-orderby-bench

Does ORDER BY over a Jev probability put rows in a defensible order? Independent ranking, calibration and invariant measurements of TypeSafe AI's Jev: passes six pre-registered gates on 360 labeled rows, fails four of six on graded product relevance.

Python
スター
0
フォーク
1

掲載理由

Jevの確率による並べ替えを360件の人手ラベルで評価した、事前登録済みの独立調査です。結果はREADMEの報告で、ここでは再現していません。

関連プロジェクト

  • jev-rag-benchmark

    Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.

    共通トピック: benchmark, calibration, information-retrieval, llm-evaluation

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共通トピック: benchmark, calibration, llm-evaluation

  • jevals-data

    Independent benchmark data for TypeSafe's Jev (System One model) vs LLMs: accuracy, calibration, cost. Boards + per-decision logs, CC-BY-4.0

    共通トピック: benchmark, calibration, llm-evaluation