laszloblum/jev-eval-harness
LLM-as-a-judge evaluation harness: a confidence-gated cascade (fast typed judge → Claude) that scores LLM outputs and gates CI on a regression diff. TypeScript, real recorded transcripts, real benchmark numbers.
No inclusion rationale available yet
View cited sourceRecord/replay regression tests for Jev (TypeSafe System One) question packs — accuracy, calibration and cost gates in CI
Shared topics: ci, evals
Cut Claude Code's skill manifest by ~75% with TypeSafe Jev. Scores every installed skill for relevance and hides the rest via skillOverrides — 12,750 → 3,185 tokens on a 217-skill install, for $0.0009 a session.
Shared topics: anthropic, claude
High-throughput synthetic and pretraining dataset sifter for TypeSafe Jev. Rust streaming core, Parquet and JSONL I/O, typed Choice/Score/Noul judgments, speculative fan-out, 24.0 rows/sec measured.
Shared topics: eval-harness