jev-certify
nikkoxgonzales/jev-certify
Finite-sample guarantees for Jev (TypeSafe's System One). Conformal risk control turns calibrated probabilities into certified routing thresholds; prediction-powered inference audits them. 2,412 decisions on CLINC150 for $0.23 — including the shift and prevalence cases where the guarantee breaks.
- Stars
- 1
- Forks
- 0
Why it is listed
A research tool applies conformal risk-control methods to turn Jev choices into routing thresholds; its reported experiment is based on logged Jev decisions.