sysone-bench
instax-dutta/sysone-bench
First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
- 星标
- 6
- 派生
- 3
收录依据
在封存的共同类型化问题集上比较 Laya、TypeSafe Jev API 与受约束 Qwen 决策的独立基准。收录对比方法,不背书所报分数。
instax-dutta/sysone-bench
First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
在封存的共同类型化问题集上比较 Laya、TypeSafe Jev API 与受约束 Qwen 决策的独立基准。收录对比方法,不背书所报分数。
Run the new wave of decision models (Laya, Decider, Kev, Jev) side by side on your Mac. Structured input in, calibrated probabilities out, with honest accuracy, calibration, latency and memory numbers.
共同主题: benchmark, calibration, evaluation, laya
Evaluation tools for Jev-compatible decision models, covering accuracy, calibration, hidden instructions, padding and consistency.
共同主题: benchmark, calibration, decision-model, evaluation
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共同主题: benchmark, calibration, laya