All projects

jev-no-enem

patryckalves/jev-no-enem

Reproducible benchmark evaluating TypeSafe AI's Jev (System One paradigm) on Brazil's ENEM 2025 standardized exam. Evaluates typed decision-making, domain-specific accuracy, and RLCD uncertainty calibration against open LLM baselines with an interactive GitHub Pages dashboard.

Python
Stars
0
Forks
0

Why it is listed

Jev no ENEM is a preliminary evaluation of TypeSafe Jev on Brazilian standardized-exam questions; the README says more trials are needed for formal statistical significance.

Related projects

  • jevals-data

    Independent benchmark data for TypeSafe's Jev (System One model) vs LLMs: accuracy, calibration, cost. Boards + per-decision logs, CC-BY-4.0

    Shared topics: benchmark, system-one-models

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    Shared topics: benchmark

  • jev-access-day

    A learning scaffold for TypeSafe AI's System One models: eval harness plus a measured, plain-language comparison of the Jev decision model vs an LLM stand-in on 24 real operational decisions. All numbers reproducible from committed run files.

    Shared topics: benchmark