全部项目

typed-lm

neurono-ml/typed-lm

Single-forward-pass semantic routing in Rust: turn dense LLMs (Llama, Qwen, Mistral, Gemma) into a typed decision API with LoRA/QLoRA training and FP8/FP4 quantization, built on Candle.

Rust
星标
10
派生
0

收录依据

通过 Rust/Candle 将解码模型转换为类型化布尔、选择和评分决策的实现,支持适配器训练及 System One 风格 HTTP 接口。按 Jev 相关替代实现收录,不认证官方身份或完全替换兼容性。

相关项目

  • ezjev

    Open 4B typed-decision model (Jev-style /v1/systemone): calibrated per-option probabilities from one prefill. Training, data generation and eval pipeline on HF Jobs.

    共同主题: huggingface, lora

  • bobcat

    Bobcat: a typed-decision model. State in, Choice / Noul / Score out, with a probability for every answer you name; no generated text. Compiler, server, training and evaluation code for Bobcat 1.1 and Bobcat Flash 1.1.

    共同主题: classification, huggingface

  • v1-decisions-vllm

    Modular typed decisions (Jev-type) endpoint for vLLM: /v1/decisions with /v1/systemone compatibility, pluggable readout backends

    共同主题: classification, inference