jev-snips-benchmark
will-rice/jev-snips-benchmark
will-rice/jev-snips-benchmark
A learning scaffold for TypeSafe AI's System One models: eval harness plus a measured, plain-language comparison of the Jev decision model vs an LLM stand-in on 24 real operational decisions. All numbers reproducible from committed run files.
共通トピック: benchmark, evaluation
Three measured experiments on RAG hallucination: quote-checking, TypeSafe's Jev, and IBM's STAIR. 850+ graded questions, raw responses included.
共通トピック: benchmark, evaluation
Run the new wave of decision models (Laya, Decider, Kev, Jev) side by side on your Mac. Structured input in, calibrated probabilities out, with honest accuracy, calibration, latency and memory numbers.
共通トピック: benchmark, evaluation