全部项目

typed-decision-bench

4nt0ineB/typed-decision-bench

Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.

Python
星标
0
派生
0

收录依据

这项小型基准在相同的英法语零样本分类任务上比较 Jev、OpenJev、Laya 及本地/托管模型;作者将结论限制在一个数据集和一种问题,本次未复现指标。

相关项目

  • jev-rag-benchmark

    Free English RAG benchmark for TypeSafe Jev 1.13 — frozen candidate pools, calibration, paired bootstrap CIs, $0 runs. Compared with OpenJev and NVIDIA cross-encoders.

    共同主题: benchmark, calibration, llm-evaluation

  • sysone-bench

    First independent head-to-head benchmark of System One decision models (Laya vs Jev) on byte-identical inputs

    共同主题: benchmark, calibration, laya

  • system-one-playground

    Run the new wave of decision models (Laya, Decider, Kev, Jev) side by side on your Mac. Structured input in, calibrated probabilities out, with honest accuracy, calibration, latency and memory numbers.

    共同主题: benchmark, calibration, laya