すべてのプロジェクト

jev-probe

Shoaib-Asghar/jev-probe

Testing environment for TypeSafe's Jev model. It applies controlled perturbations (typos, adversarial text, reordering) to test cases, executes real API calls, and logs the raw JSON responses to DuckDB. Includes a web dashboard to track probability shifts, latency, and cost against an LLM baseline.

Python
スター
0
フォーク
0

掲載理由

意味を保つ入力変形に対する Jev と基準 LLM の判断の一貫性を比較し、確信度・費用・遅延を記録する探索ハーネス。

カテゴリー

タグ

関連プロジェクト

  • jev-demo

    JEV Studio is a small Next.js evaluation lab for turning natural-language input into structured signals with the Typesafe SystemOne API.

    共通トピック: jev-model

  • what-the-jev

    What can Jev actually do? Reproducible experiments and research reports exploring its capabilities and limits.

    共通トピック: jev-model

  • typed-decision-bench

    Large typed decision model evaluation benchmark and novel calibration standard (`calibration.json`) for any typed decision inference system, covering 275 distinct use-cases and 27,598 individual decisions for Jev-like open typed decision models.

    共通トピック: jev-model