jevoss
mertkayacs/jevoss
Evaluation tools for Jev-compatible decision models, covering accuracy, calibration, hidden instructions, padding and consistency.
Python
- スター
- 2
- フォーク
- 1
掲載理由
掲載理由は準備中です
参照元を見る関連プロジェクト
- sysone-bench
First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
共通トピック: benchmark, calibration, decision-model, evaluation
- typed-decision-bench
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共通トピック: benchmark, calibration, llm-evaluation
- jev-rag-benchmark
Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.
共通トピック: benchmark, calibration, llm-evaluation