全部项目

jev-ragcheck

gabazureus/jev-ragcheck

RAG evaluation with typed decisions: sentence-level hallucination verdicts with offsets and citations, passage and answer relevance, in one Jev call per answer. Benchmarked against Ragas, DeepEval, an LLM judge and HHEM.

Python
星标
0
派生
0

收录依据

RAG 评估器由代码切分答案,再用 Jev 固定选项判断为句子关联判定与检索证据。

相关项目

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共同主题: benchmark, llm-evaluation

  • jev-rag-benchmark

    Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.

    共同主题: benchmark, llm-evaluation

  • water-supply-prioritizer

    Score TypeSafe's Jev on water-supply triage reports: a zero-dependency Python benchmark that answers urgency, scope, cause, priority and escalation questions and checks them against your team's expected policy.

    共同主题: benchmark, llm-evaluation