calibre
FirasSX914/calibre
Measure when to use Jev and other models on your data, then route accordingly.
Python
- スター
- 2
- フォーク
- 0
掲載理由
Janusは測定した確信度の閾値で判断を振り分け、主モデルに`typesafe:jev-latest`を指定できます。
FirasSX914/calibre
Measure when to use Jev and other models on your data, then route accordingly.
Janusは測定した確信度の閾値で判断を振り分け、主モデルに`typesafe:jev-latest`を指定できます。
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共通トピック: benchmark, calibration
How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.
共通トピック: benchmark, calibration
Jev-compatible /v1/systemone server reading typed decisions from LLM logits, benchmarked against TypeSafe's Jev on the same items via JevBench
共通トピック: benchmark, calibration