sysone-bench
instax-dutta/sysone-bench
First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
- スター
- 6
- フォーク
- 3
掲載理由
封印した共通の型付き質問で Laya・TypeSafe Jev API・制約付き Qwen を比較する独立評価。比較方法を資料として収録し、報告点数を保証しない。
instax-dutta/sysone-bench
First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
封印した共通の型付き質問で Laya・TypeSafe Jev API・制約付き Qwen を比較する独立評価。比較方法を資料として収録し、報告点数を保証しない。
Run the new wave of decision models (Laya, Decider, Kev, Jev) side by side on your Mac. Structured input in, calibrated probabilities out, with honest accuracy, calibration, latency and memory numbers.
共通トピック: benchmark, calibration, evaluation, laya
Evaluation tools for Jev-compatible decision models, covering accuracy, calibration, hidden instructions, padding and consistency.
共通トピック: benchmark, calibration, decision-model, evaluation
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共通トピック: benchmark, calibration, laya