battleship-vs-jev
ickas/battleship-vs-jev
A 60-game benchmark of TypeSafe's Jev evaluation model playing Battleship. The model matches plain code; it does not beat it.
- 星标
- 0
- 派生
- 0
收录依据
这是 Jev 战舰游戏基准,将 Jev 选点与纯代码策略对比,并可视化格子概率;README 强调对照方法,本次不验证成绩。
ickas/battleship-vs-jev
A 60-game benchmark of TypeSafe's Jev evaluation model playing Battleship. The model matches plain code; it does not beat it.
这是 Jev 战舰游戏基准,将 Jev 选点与纯代码策略对比,并可视化格子概率;README 强调对照方法,本次不验证成绩。
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共同主题: benchmark, llm-evaluation
Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.
共同主题: benchmark, llm-evaluation
RAG evaluation with typed decisions: sentence-level hallucination verdicts with offsets and citations, passage and answer relevance, in one Jev call per answer. Benchmarked against Ragas, DeepEval, an LLM judge and HHEM.
共同主题: benchmark, llm-evaluation