すべてのプロジェクト

sysone-bench

instax-dutta/sysone-bench

First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs

Python
スター
6
フォーク
3

掲載理由

封印した共通の型付き質問で Laya・TypeSafe Jev API・制約付き Qwen を比較する独立評価。比較方法を資料として収録し、報告点数を保証しない。

関連プロジェクト

  • system-one-playground

    Run the new wave of decision models (Laya, Decider, Kev, Jev) side by side on your Mac. Structured input in, calibrated probabilities out, with honest accuracy, calibration, latency and memory numbers.

    共通トピック: benchmark, calibration, evaluation, laya

  • jevoss

    Evaluation tools for Jev-compatible decision models, covering accuracy, calibration, hidden instructions, padding and consistency.

    共通トピック: benchmark, calibration, decision-model, evaluation

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共通トピック: benchmark, calibration, laya