jev-test
clduab11/jev-test
Pre-registered benchmark: can a 2B local model (Gemma 4 E2B) answer web questions without making things up when a decision model (TypeSafe Jev) makes every call? SearXNG for search, MemPalace for verbatim memory, seven arms including open local judges. Spec and thresholds fixed before any run.
- スター
- 1
- フォーク
- 0
掲載理由
jev-testは検索・根拠選択・文の裏付けを別モデルのTypeSafe Jevで判定する研究用ハーネスで、READMEは判定付き構成が基準を下回ったとも記す。