すべてのプロジェクト

jev-certify

nikkoxgonzales/jev-certify

Finite-sample guarantees for Jev (TypeSafe's System One). Conformal risk control turns calibrated probabilities into certified routing thresholds; prediction-powered inference audits them. 2,412 decisions on CLINC150 for $0.23 — including the shift and prevalence cases where the guarantee breaks.

Python
スター
1
フォーク
0

掲載理由

研究ツールがコンフォーマルリスク制御でJevの選択を振り分けしきい値に変換し、記録した判定で実験したと報告しています。

関連プロジェクト

  • jev-measured

    Measured cost, latency, accuracy and raw output: TypeSafe's Jev and 12 other decision models (OpenAI Decisions API, Clef, Decider, d1…) — reproducible

    共通トピック: decision-models, llm-routing

  • jev-fanout-bench

    Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.

    共通トピック: openrouter

  • JEV

    JEV 调研报告:TypeSafe System One 决策模型与开源对标(含原始核实记录)

    共通トピック: llm-routing