jev-router
rajdhakad9826/jev-router
LLM router that picks the cheapest model capable of handling a query, using TypeSafe's Jev for fast classification instead of an LLM call.
TypeScript
- 星标
- 13
- 派生
- 1
收录依据
该路由器先用 Jev 判断请求难度,再将请求路由到配置的 LLM 层级。
rajdhakad9826/jev-router
LLM router that picks the cheapest model capable of handling a query, using TypeSafe's Jev for fast classification instead of an LLM call.
该路由器先用 Jev 判断请求难度,再将请求路由到配置的 LLM 层级。