typed-lm
neurono-ml/typed-lm
Single-forward-pass semantic routing in Rust: turn dense LLMs (Llama, Qwen, Mistral, Gemma) into a typed decision API with LoRA/QLoRA training and FP8/FP4 quantization, built on Candle.
Open-source alternativesRust
- Stars
- 9
- Forks
- 0
Why it is listed
No inclusion rationale available yet
View cited sourceTopics
jevactix-webcandleclassificationhuggingfaceinferencellmlora