jev-tool-search
kachar/jev-tool-search
Tool search for LLM agents: BM25 vs embeddings vs rerankers vs Jev on 525 real MCP tools, plus an experimental Jev search engine
- 星标
- 3
- 派生
- 0
收录依据
工具选择基准将 Jev 与词法、嵌入和重排方法比较,同时提供实验性的 Jev 搜索引擎。
kachar/jev-tool-search
Tool search for LLM agents: BM25 vs embeddings vs rerankers vs Jev on 525 real MCP tools, plus an experimental Jev search engine
工具选择基准将 Jev 与词法、嵌入和重排方法比较,同时提供实验性的 Jev 搜索引擎。
A reproducible, self-hosted benchmark for comparing JEV and LLM decision-making on your own datasets, models, and evaluation policies.
共同主题: agents, benchmark
Bench of typed decision models: Jev vs OpenJev vs Laya, small local LLMs and cheap hosted LLMs on the same zero-shot classification tasks, in English and French.
共同主题: benchmark
A learning scaffold for TypeSafe AI's System One models: eval harness plus a measured, plain-language comparison of the Jev decision model vs an LLM stand-in on 24 real operational decisions. All numbers reproducible from committed run files.
共同主题: benchmark