TypeSafe Jev / System One モデルの無料 GitHub プロジェクト集公式 SDK、エージェントツール、オープンソースの代替実装と Jev の最新ニュースを紹介

データ更新

すべてのタグ

タグ:benchmark

benchmark タグの付いた Jev GitHub プロジェクトを検索・並べ替えし、元のリポジトリを確認できます。

  • Get coding agents to write Jev questions that work the first time: rules measured on 57 labelled suites.

    BarakChamo/jev-kit · JavaScript

    00
    agent-skillsai-agentsbenchmarkcalibrationclaude-codeclaude-code-pluginclaude-code-skill
  • Reproducible benchmark evaluating TypeSafe AI's Jev (System One paradigm) on Brazil's ENEM 2025 standardized exam. Evaluates typed decision-making, domain-specific accuracy, and RLCD uncertainty calibration against open LLM baselines with an interactive GitHub Pages dashboard.

    patryckalves/jev-no-enem · Python

    00
    benchmarkbrasilenemllmrlcdpython
  • Does ORDER BY over a Jev probability put rows in a defensible order? Independent ranking, calibration and invariant measurements of TypeSafe AI's Jev: passes six pre-registered gates on 360 labeled rows, fails four of six on graded product relevance.

    yodablocks/jev-orderby-bench · Python

    01
    benchmarkcalibrationduckdbinformation-retrievalllm-evaluationpythonranking
  • Put Jev in the pilot's seat of a web quiz. A Python CLI that lets TypeSafe's Jev navigate quizzes in your Chrome and logs every pick, so you can measure how it does.

    juanfabrega/jev-quiz-pilot · Python

    00
    benchmarkbrowser-automationclillm-evaluationopenrouterplaywrightpython
  • Reproducible Chinese RAG reranking benchmark for Jev (TypeSafe System One) — private during build, protocol + scripts + full logs. EN/中文.

    vicfei/jev-rag-zh-benchmark · Python

    00
    benchmarkchineseragreproducible-researchrerankingt2ranking
  • RAG evaluation with typed decisions: sentence-level hallucination verdicts with offsets and citations, passage and answer relevance, in one Jev call per answer. Benchmarked against Ragas, DeepEval, an LLM judge and HHEM.

    gabazureus/jev-ragcheck · Python

    00
    benchmarkfaithfulnesshallucination-detectionllm-as-a-judgellm-evaluationportuguesepython
  • Applying Jev to zero-shot tool calling on the Berkeley Function Calling Leaderboard (BFCL)

    will-rice/jev-tool-calling · Python

    01
    benchmarkbfclevaluationfunction-callingllm-agentstoken-classificationtool-calling
  • Does a System One model actually beat keyword matching? A reproducible benchmark on catching disguised duplicate thesis titles. 24 cases, real production baseline, raw data and charts included.

    devnolife/jev-vs-tfidf-benchmark · TypeScript

    00
    benchmarkindonesiainformation-retrievalllmplagiarism-detectionstructured-outputtf-idf
  • A semantic-decision benchmark comparing Jev with general-purpose LLMs in a fictional Mars entry checkpoint.

    komzweb/mars-gate · TypeScript

    00
    benchmarkllmreacttypescript
  • An independent, reproducible benchmark of TypeSafe's Jev against open, CPU-only alternatives — 10,000 decisions, all raw results published.

    zhlei07/open-system-one · Python

    00
    benchmarkcpu-inferencecross-encoderembeddingstext-classificationzero-shot-classification
  • How many decisions can a model make in a minute, and what do they cost? Jev, a System One decision model, raced against six LLMs on the same Snake boards.

    angelgalvisc/snake-arena-jev-vs-llms · Python

    00
    anthropicbenchmarkcalibrationdecision-makinglatencyllmmoonshot
  • Jev vs Laya on Bulgarian: two System One models suggest a category for each blog post. A local BgGPT names new topics.

    SciScend/system-one-categorizer-demo · Python

    00
    ai-agentsbenchmarkbggptbulgarianlayallmmodel-comparison
  • Run the new wave of decision models (Laya, Decider, Kev, Jev) side by side on your Mac. Structured input in, calibrated probabilities out, with honest accuracy, calibration, latency and memory numbers.

    jeffclimbsbikes/system-one-playground · TypeScript

    01
    apple-siliconbenchmarkcalibrationclassificationdecision-modelevaluationlaya
  • Large typed decision model evaluation benchmark and novel calibration standard (`calibration.json`) for any typed decision inference system, covering 275 distinct use-cases and 27,598 individual decisions for Jev-like open typed decision models.

    kyr0/typed-decision-bench · Python

    00
    benchmarkbenchmark-frameworkcalibrationjev-alternativejev-api
  • Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

    4nt0ineB/typed-decision-bench · Python

    00
    benchmarkcalibrationenglishfrenchlayallm-evaluationmassive-dataset
  • Score TypeSafe's Jev on water-supply triage reports: a zero-dependency Python benchmark that answers urgency, scope, cause, priority and escalation questions and checks them against your team's expected policy.

    hariprasad2512/water-supply-prioritizer · Python

    00
    benchmarkllm-evaluationpythonwater-supply

66 件中 51–66 件