标签：evaluation

查找带有 evaluation 标签的 Jev GitHub 项目，筛选、排序并查看原始仓库。

115jevals
Agent evals and guardrails as Jev decisions: one request per trace, a fraction of a cent, fast enough for the agent loop. Runs locally with Kev or Laya.
openlayer-ai/jevals · Python
1029
ai-agentsevaluationguardrailsllmllm-evaluationragas
207jev-benchmarks
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
AbdelStark/jev-benchmarks · Python
265
pythonbenchmarkingcalibrationevaluation
275jev-harness
Decision harness for TypeSafe Jev — confidence gates, shadow mode, recipes, and evals. Claude CLI 48.9s → Jev 1.3s on the same row-filter job.
AntonioCoppe/jev-harness · TypeScript
152
ai-agentsconfidencedecisionevaluationharnessllm
279typed_evals
Fast, typed, calibrated evaluations for LLM and agent outputs, powered by Jev — with simple, framework-agnostic Python APIs
TrustifAI/typed_evals · Python
151
ai-agentscrewaievaluationevaluation-frameworkevaluation-metrics
377jev-state
Build and regression-test conversational state machines powered by Jev. Inspect decisions, capture failing conversations as tests, and export runnable TypeScript for your app.
priyankark/jev-state · TypeScript
80
ai-agentscode-generationconversational-aideveloper-toolsevaluationllm-evaluationlocal-first
391what-the-jev
What can Jev actually do? Reproducible experiments and research reports exploring its capabilities and limits.
keta1930/what-the-jev · Python
81
benchmarkdecision-modelevaluationllm-evaluation
459sysone-bench
First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs
instax-dutta/sysone-bench · Python
62
benchmarkcalibrationdecision-modelevaluationlayallm-eval
555openevals
Fast and cheap agent evals. jev as judge.
memovai/openevals · TypeScript
40
ai-agentsevaluationlangchainlangfuseobservabilitytypescript
651no-hallucination
Three measured experiments on RAG hallucination: quote-checking, TypeSafe's Jev, and IBM's STAIR. 850+ graded questions, raw responses included.
aryanchauhanoffical/no-hallucination · Python
30
benchmarkevaluationhallucinationllmragretrieval
737jev-by-example
Ten runnable Jev examples for agent decisions: memory conflicts, tool-result checks, recovery, context selection, and handoffs. JavaScript, zero dependencies.
ReallyArtificial/jev-by-example · JavaScript
21
agent-memoryai-agentsevaluationexamplesgood-first-issuehacktoberfesthelp-wanted
741jev-decision-bench
A reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.
Tenkei/jev-decision-bench · Python
20
ai-agentsanthropicbenchmarkdeepseekevaluationllmopenai
922here-we-go-jev
Local playground and test bench for TypeSafe's Jev System One model: typed questions, calibrated-probability answers, and side-by-side comparison with an LLM baseline.
creativoma/here-we-go-jev · TypeScript
10
buncalibrationclassificationevaluationllmopenrouter
940jev_playground
Measure what Jev can actually do before you build on it. Graded findings, ruled-out candidates, and recipes with stop-conditions. 0 promotions — on purpose.
JYeswak/jev_playground · Python
10
ai-agentsbenchmarkevaluationllmpython
967jev-crash-course
An 11-level crash course on Jev, TypeSafe AI's System One decision model — runnable examples against the real API, plus a capstone project with unit tests and evals. Works with any LLM provider via LiteLLM.
nadeemcite/jev-crash-course · Python
10
ai-agentscrash-courseevaluationlitellmllmpython
1003jev-lab
Hands-on research lab for TypeSafe's Jev (System One model): reproducible benchmarks of Noul/Choice/Score primitives, confidence gating, fan-out latency, agent control — plus a living audit of the Jev ecosystem.
llt22/jev-lab · Python
10
ai-agentsbenchmarkconfidence-calibrationevaluationllmllm-evaluationllm-observability
1011jev-mahjong-bench
Reproducible riichi mahjong benchmark for Jev, GPT, Mortal, and hybrid agents using MJAI and RiichiEnv.
hamakyo/jev-mahjong-bench · TypeScript
10
benchmarkevaluationgame-aigpthybrid-agentsmahjongmahjong-ai
1071jevbench
Preregistered, bias-corrected test of TypeSafe Jev's calibration under human disagreement (ChaosNLI, 100 labels per item)
GautamTalksDev/jevbench · Python
10
calibrationchaosnlievaluationpreregistrationpython
1100JudgeJev
A hands-on educational lab for DeepEval + Jev: inspect real recorded judgments, explore release gates and drift playback, and run fresh evaluations on your own workloads.
shyamsridhar123/JudgeJev · Python
10
deepevaldrift-detectionenterprise-aievaluationllm-evaluationllmopspython
1161stuntdouble
Drop-in /v1/systemone proxy that shadows Jev with local decision models (Kev, Laya) and reports whether you can swap
ReallyArtificial/stuntdouble · JavaScript
10
ai-agentsevaluationgood-first-issuehelp-wantedjavascriptkevlaya
1356fastgate-jev
Jev (TypeSafe AI) as a System One decision layer for a multilingual EN/UZ/RU RAG helpdesk, with an independent benchmark
rajantripathi/fastgate-jev · Python
00
ai-agentsevaluationllm-routingmultilingualraguzbek
1433jev-access-day
A learning scaffold for TypeSafe AI's System One models: eval harness plus a measured, plain-language comparison of the Jev decision model vs an LLM stand-in on 24 real operational decisions. All numbers reproducible from committed run files.
andreaserradev-gbj/jev-access-day · TypeScript
00
benchmarkdecision-supportevaluationllmtype-safety

第 1–32 条，共 32 条