すべてのプロジェクト

battleship-vs-jev

ickas/battleship-vs-jev

A 60-game benchmark of TypeSafe's Jev evaluation model playing Battleship. The model matches plain code; it does not beat it.

TypeScript
スター
0
フォーク
0

掲載理由

Jevの戦艦ゲームをコードのみの戦略と比較し、各マスの確率を可視化するベンチマークです。成績の数値は本レビューで検証していません。

関連プロジェクト

  • typed-decision-bench

    Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    共通トピック: benchmark, llm-evaluation

  • jev-rag-benchmark

    Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.

    共通トピック: benchmark, llm-evaluation

  • jev-ragcheck

    RAG evaluation with typed decisions: sentence-level hallucination verdicts with offsets and citations, passage and answer relevance, in one Jev call per answer. Benchmarked against Ragas, DeepEval, an LLM judge and HHEM.

    共通トピック: benchmark, llm-evaluation