全部项目

jev-acento

marcosmartinez/jev-acento

¿Jev entiende tu acento? Pre-registered audit of TypeSafe AI's Jev on Spanish — accuracy, calibration and token cost — plus a CLI to run the same comparison on your own labelled data.

Python
星标
0
派生
1

收录依据

jev-acento 是针对西班牙语数据的 Jev 独立可复现实验,并提供在标注数据上重复比较的命令行工具。

相关项目

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共同主题: benchmark, calibration, llm-evaluation

  • jev-rag-benchmark

    Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.

    共同主题: benchmark, calibration, llm-evaluation

  • jevals-data

    Independent benchmark data for TypeSafe's Jev (System One model) vs LLMs: accuracy, calibration, cost. Boards + per-decision logs, CC-BY-4.0

    共同主题: benchmark, calibration, llm-evaluation