v1-decisions-vllm

Timiku/v1-decisions-vllm

Modular typed decisions (Jev-type) endpoint for vLLM: /v1/decisions with /v1/systemone compatibility, pluggable readout backends

Python

Stars: 1
Forks: 0

Why it is listed

No inclusion rationale available yet

View cited source

Categories

Open-source alternatives

Tags

classification inference inference-api llm typed-decisions vllm python

Related projects

typed-lm
Single-forward-pass semantic routing in Rust: turn dense LLMs (Llama, Qwen, Mistral, Gemma) into a typed decision API with LoRA/QLoRA training and FP8/FP4 quantization, built on Candle.
Shared topics: classification, inference
decima
Open, CPU-sized Jev-style (System One) decision model: situation + question + options → calibrated probabilities. 122M, ~20 ms on one CPU core, runs in your browser.
Shared topics: typed-decisions
judgment
Typed, calibrated judgments from System One models: a decision written as a .jud file or as Rust types, answered by a model, verified before it is read, testable with no key. Rust crate, jud CLI (cat event.json | jud triage.jud), Claude Code plugin. Not affiliated with TypeSafe AI.
Shared topics: classification