すべてのプロジェクト

jev-ragcheck

gabazureus/jev-ragcheck

RAG evaluation with typed decisions: sentence-level hallucination verdicts with offsets and citations, passage and answer relevance, in one Jev call per answer. Benchmarked against Ragas, DeepEval, an LLM judge and HHEM.

Python
スター
0
フォーク
0

掲載理由

コードで回答を分割し、Jev の固定選択肢による判断で各文の評価と検索証拠を対応付ける RAG 評価器。

関連プロジェクト

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共通トピック: benchmark, llm-evaluation

  • jev-rag-benchmark

    Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.

    共通トピック: benchmark, llm-evaluation

  • water-supply-prioritizer

    Score TypeSafe's Jev on water-supply triage reports: a zero-dependency Python benchmark that answers urgency, scope, cause, priority and escalation questions and checks them against your team's expected policy.

    共通トピック: benchmark, llm-evaluation