pytest-jev
allebee/pytest-jev
Semantic assertions for pytest: test what your LLM app's output means, judged by TypeSafe's Jev.
Python
- スター
- 8
- フォーク
- 1
掲載理由
pytest-jevはLLMアプリの出力に意味的な検査を加え、文言の完全一致ではなくJevの確率判定で評価します。
allebee/pytest-jev
Semantic assertions for pytest: test what your LLM app's output means, judged by TypeSafe's Jev.
pytest-jevはLLMアプリの出力に意味的な検査を加え、文言の完全一致ではなくJevの確率判定で評価します。
Record/replay regression tests for Jev (TypeSafe System One) question packs — accuracy, calibration and cost gates in CI
共通トピック: llm-evaluation, testing
YAML-based evaluation runner for recorded LLM outputs, with TypeSafe Jev API integration, offline mock mode, and CI reports.
共通トピック: testing
A Jev-powered quality gate for GitHub issues, pull requests, and commits.
共通トピック: llm-evaluation