タグ：benchmark
benchmark タグの付いた Jev GitHub プロジェクトを検索・並べ替えし、元のリポジトリを確認できます。
- Weekly builds on Jev (TypeSafe AI), benchmarked honestly enough to publish. Week 01: inbound lead triage, 90% routing at 366ms and $0.04 per thousand leads.
deepdave98/jev-playground · Python
301benchmarkgtmlead-scoringllmrevopshtml - Independent, evidence-based map of when TypeSafe's Jev actually holds up vs. breaks down — real API-call receipts, not a leaderboard. 中文為主的雙語 repo。
Zaious/jev-capability-atlas · Python
276ai-agentsbenchmarkcalibrationllm-evaluationmachine-learningzh-tw - Evidence-backed index of real-world Jev (TypeSafe AI System One) use cases: repos, patterns, benchmarks, and measured results
anandi1989/awesome-jev-usecases
196ai-agentsawesome-listbenchmarkbrowser-agentscalibration - Independent, reproducible benchmark: a decision model (jev), eight constrained LLMs, and deterministic baselines on typed decisions - accuracy, calibration, latency, cost, failure modes
nibzard/decision-model-benchmark · HTML
110benchmarkcalibrationdecision-modelllm-evaluationreproducibilityhtml - 391what-the-jevWhat can Jev actually do? Reproducible experiments and research reports exploring its capabilities and limits.
keta1930/what-the-jev · Python
81benchmarkdecision-modelevaluationllm-evaluation - Real-world Jev use cases, open-source projects, benchmarks and criticism — what people actually build with TypeSafe AI's Jev, and where it fails. Machine-readable, updated daily.
Jessie-QingYu/jev-in-the-wild · JavaScript
74ai-agentsawesome-listbenchmarkclassificationllmtyped-decisions - 459sysone-benchFirst independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
instax-dutta/sysone-bench · Python
62benchmarkcalibrationdecision-modelevaluationlayallm-eval - Putting TypeSafe's Jev to work on robots, fleets, and edge hardware — real measured numbers, honestly caveated.
robokrunch/jev-physical-ai · Python
30benchmarkedge-aiphysical-airoboticspython - Three measured experiments on RAG hallucination: quote-checking, TypeSafe's Jev, and IBM's STAIR. 850+ graded questions, raw responses included.
aryanchauhanoffical/no-hallucination · Python
30benchmarkevaluationhallucinationllmragretrieval - 702calibreMeasure when to use Jev and other models on your data, then route accordingly.
FirasSX914/calibre · Python
20pythonbenchmarkcalibrationconfidence - A reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.
Tenkei/jev-decision-bench · Python
20ai-agentsanthropicbenchmarkdeepseekevaluationllmopenai - Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.
emretheus/jev-rag-benchmark · Python
20benchmarkcalibrationinformation-retrievalllm-evaluationnvidiaopenjevrag - Jev vs GPT-4.1 as synthetic survey respondents on Twin-2K-500. How you ask mattered more than which model you used.
jjd-lab/jev-synthetic-survey · Python
20behavioral-economicsbenchmarkcalibrationdigital-twindigital-twinsllmllm-evaluation - Tool search for LLM agents: BM25 vs embeddings vs rerankers vs Jev on 525 real MCP tools, plus an experimental Jev search engine
kachar/jev-tool-search · TypeScript
20ai-agentsai-sdkbenchmarkbm25llmmcptool-search - 899ezjevOpen 4B typed-decision model (Jev-style /v1/systemone): calibrated per-option probabilities from one prefill. Training, data generation and eval pipeline on HF Jobs.
everettjf/ezjev · Python
10benchmarkcalibrationdecision-modelfine-tuninghuggingfacellmlora - Measure what Jev can actually do before you build on it. Graded findings, ruled-out candidates, and recipes with stop-conditions. 0 promotions — on purpose.
JYeswak/jev_playground · Python
10ai-agentsbenchmarkevaluationllmpython - Battleship against Jev, a model that answers in probabilities instead of text. Web game plus a CLI arena that plays it against general-purpose LLMs on identical fleets.
sah1l/jev-battleship · JavaScript
10battleshipbenchmarkllmprompt-engineeringverceljavascript - A benchmark for Jev's biases, built from people who differ in one attribute at a time.
Fox-Islam/jev-bias-bench · PHP
10ai-fairnessalgorithmic-biasaudit-studybenchmarkbias-detectioncounterfactualdiscrimination - 1003jev-labHands-on research lab for TypeSafe's Jev (System One model): reproducible benchmarks of Noul/Choice/Score primitives, confidence gating, fan-out latency, agent control — plus a living audit of the Jev ecosystem.
llt22/jev-lab · Python
10ai-agentsbenchmarkconfidence-calibrationevaluationllmllm-evaluationllm-observability - Reproducible riichi mahjong benchmark for Jev, GPT, Mortal, and hybrid agents using MJAI and RiichiEnv.
hamakyo/jev-mahjong-bench · TypeScript
10benchmarkevaluationgame-aigpthybrid-agentsmahjongmahjong-ai - 1037jev-simJev-compatible /v1/systemone server reading typed decisions from LLM logits, benchmarked against TypeSafe's Jev on the same items via JevBench
dashbi1/jev-sim · Python
10benchmarkcalibrationclassificationllmlogprobspython
47 件中 1–47 件