全部项目

jev-certify

nikkoxgonzales/jev-certify

Finite-sample guarantees for Jev (TypeSafe's System One). Conformal risk control turns calibrated probabilities into certified routing thresholds; prediction-powered inference audits them. 2,412 decisions on CLINC150 for $0.23 — including the shift and prevalence cases where the guarantee breaks.

Python
星标
1
派生
0

收录依据

研究工具用保形风险控制方法把 Jev 选择转为路由阈值;其报告实验基于记录的 Jev 判断。

相关项目

  • jev-measured

    Measured cost, latency, accuracy and raw output: TypeSafe's Jev and 12 other decision models (OpenAI Decisions API, Clef, Decider, d1…) — reproducible

    共同主题: decision-models, llm-routing

  • jev-fanout-bench

    Measured: asking TypeSafe Jev N questions in one call bills the state once. 2,976 real requests, raw data, exact billing check.

    共同主题: openrouter

  • JEV

    JEV 调研报告:TypeSafe System One 决策模型与开源对标(含原始核实记录)

    共同主题: llm-routing