jev-relevancy
rickcrawford/jev-relevancy
Search evaluation with Jev as the judge. turbopuffer does the retrieval and hosted reranking, and DuckDB keeps every run and computes the metrics in SQL.
- 星标
- 1
- 派生
- 0
收录依据
暂无收录依据
查看引用来源rickcrawford/jev-relevancy
Search evaluation with Jev as the judge. turbopuffer does the retrieval and hosted reranking, and DuckDB keeps every run and computes the metrics in SQL.
暂无收录依据
查看引用来源Does ORDER BY over a Jev probability put rows in a defensible order? Independent ranking, calibration and invariant measurements of TypeSafe AI's Jev: passes six pre-registered gates on 360 labeled rows, fails four of six on graded product relevance.
共同主题: duckdb, information-retrieval
Reproducible experiments evaluating Jev as an automated judge across benchmarks and tasks.
共同主题: information-retrieval
Does a System One model actually beat keyword matching? A reproducible benchmark on catching disguised duplicate thesis titles. 24 cases, real production baseline, raw data and charts included.
共同主题: information-retrieval