全部项目

jev-no-enem

patryckalves/jev-no-enem

Reproducible benchmark evaluating TypeSafe AI's Jev (System One paradigm) on Brazil's ENEM 2025 standardized exam. Evaluates typed decision-making, domain-specific accuracy, and RLCD uncertainty calibration against open LLM baselines with an interactive GitHub Pages dashboard.

Python
星标
0
派生
0

收录依据

Jev no ENEM 是对 TypeSafe Jev 解答巴西标准化考试题的初步评估;README 说明若要进行正式统计显著性分析仍需更多试验。

相关项目

  • jevals-data

    Independent benchmark data for TypeSafe's Jev (System One model) vs LLMs: accuracy, calibration, cost. Boards + per-decision logs, CC-BY-4.0

    共同主题: benchmark, system-one-models

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共同主题: benchmark

  • jev-access-day

    A learning scaffold for TypeSafe AI's System One models: eval harness plus a measured, plain-language comparison of the Jev decision model vs an LLM stand-in on 24 real operational decisions. All numbers reproducible from committed run files.

    共同主题: benchmark