jevbench
GautamTalksDev/jevbench
Preregistered, bias-corrected test of TypeSafe Jev's calibration under human disagreement (ChaosNLI, 100 labels per item)
Python
- 星标
- 1
- 派生
- 0
收录依据
独立预注册的 ChaosNLI 研究,检查人类标注者分歧时 Jev 置信度是否降低。收录实证资料,不认证校准结论。
GautamTalksDev/jevbench
Preregistered, bias-corrected test of TypeSafe Jev's calibration under human disagreement (ChaosNLI, 100 labels per item)
独立预注册的 ChaosNLI 研究,检查人类标注者分歧时 Jev 置信度是否降低。收录实证资料,不认证校准结论。
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
共同主题: calibration, evaluation
Local playground and test bench for TypeSafe's Jev System One model: typed questions, calibrated-probability answers, and side-by-side comparison with an LLM baseline.
共同主题: calibration, evaluation
First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
共同主题: calibration, evaluation