All projects

jev-ragcheck

gabazureus/jev-ragcheck

RAG evaluation with typed decisions: sentence-level hallucination verdicts with offsets and citations, passage and answer relevance, in one Jev call per answer. Benchmarked against Ragas, DeepEval, an LLM judge and HHEM.

Python
Stars
0
Forks
0

Why it is listed

RAG evaluator splits answers in code and uses Jev fixed-option judgments to associate sentence-level verdicts with retrieved evidence.

Related projects

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    Shared topics: benchmark, llm-evaluation

  • jev-rag-benchmark

    Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.

    Shared topics: benchmark, llm-evaluation

  • water-supply-prioritizer

    Score TypeSafe's Jev on water-supply triage reports: a zero-dependency Python benchmark that answers urgency, scope, cause, priority and escalation questions and checks them against your team's expected policy.

    Shared topics: benchmark, llm-evaluation