すべてのプロジェクト

jev-no-enem

patryckalves/jev-no-enem

Reproducible benchmark evaluating TypeSafe AI's Jev (System One paradigm) on Brazil's ENEM 2025 standardized exam. Evaluates typed decision-making, domain-specific accuracy, and RLCD uncertainty calibration against open LLM baselines with an interactive GitHub Pages dashboard.

Python
スター
0
フォーク
0

掲載理由

Jev no ENEMはブラジルの標準試験問題でTypeSafe Jevを評価する予備調査で、正式な統計的有意性には追加試行が必要とREADMEに記す。

関連プロジェクト

  • jevals-data

    Independent benchmark data for TypeSafe's Jev (System One model) vs LLMs: accuracy, calibration, cost. Boards + per-decision logs, CC-BY-4.0

    共通トピック: benchmark, system-one-models

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共通トピック: benchmark

  • jev-access-day

    A learning scaffold for TypeSafe AI's System One models: eval harness plus a measured, plain-language comparison of the Jev decision model vs an LLM stand-in on 24 real operational decisions. All numbers reproducible from committed run files.

    共通トピック: benchmark