All projects

typed-lm

neurono-ml/typed-lm

Single-forward-pass semantic routing in Rust: turn dense LLMs (Llama, Qwen, Mistral, Gemma) into a typed decision API with LoRA/QLoRA training and FP8/FP4 quantization, built on Candle.

Rust
Stars
10
Forks
0

Why it is listed

A Rust/Candle implementation that turns decoder models into typed boolean, choice and score decisions, with adapter training and a System One-style HTTP interface. Listed as a related alternative to Jev, not proof of TypeSafe affiliation or drop-in compatibility.

Related projects

  • ezjev

    Open 4B typed-decision model (Jev-style /v1/systemone): calibrated per-option probabilities from one prefill. Training, data generation and eval pipeline on HF Jobs.

    Shared topics: huggingface, lora

  • bobcat

    Bobcat: a typed-decision model. State in, Choice / Noul / Score out, with a probability for every answer you name; no generated text. Compiler, server, training and evaluation code for Bobcat 1.1 and Bobcat Flash 1.1.

    Shared topics: classification, huggingface

  • v1-decisions-vllm

    Modular typed decisions (Jev-type) endpoint for vLLM: /v1/decisions with /v1/systemone compatibility, pluggable readout backends

    Shared topics: classification, inference