jev-relevancy
rickcrawford/jev-relevancy
Search evaluation with Jev as the judge. turbopuffer does the retrieval and hosted reranking, and DuckDB keeps every run and computes the metrics in SQL.
- スター
- 1
- フォーク
- 0
掲載理由
掲載理由は準備中です
参照元を見るrickcrawford/jev-relevancy
Search evaluation with Jev as the judge. turbopuffer does the retrieval and hosted reranking, and DuckDB keeps every run and computes the metrics in SQL.
掲載理由は準備中です
参照元を見るDoes ORDER BY over a Jev probability put rows in a defensible order? Independent ranking, calibration and invariant measurements of TypeSafe AI's Jev: passes six pre-registered gates on 360 labeled rows, fails four of six on graded product relevance.
共通トピック: duckdb, information-retrieval
Reproducible experiments evaluating Jev as an automated judge across benchmarks and tasks.
共通トピック: information-retrieval
Does a System One model actually beat keyword matching? A reproducible benchmark on catching disguised duplicate thesis titles. 24 cases, real production baseline, raw data and charts included.
共通トピック: information-retrieval