jevIMAGE
用 Jev 做 SLO 感知的推理路由
把 Jev 当类型化决策模型，按预测质量、延迟、成本和后端负载为每个请求挑选最合适的 LLM。
Zeeshan
@zeeshan_utd2026.09.20收录原推发布于 2026.09.20
Zeeshan @zeeshan_utd原推发布于 2026.09.20
Built an SLO-aware inference router using Jev It uses Jev as a typed decision model to select the optimal LLM for each request based on predicted quality, latency, cost, and live backend load Releasing full walkthrough video soon
x.com/zeeshan_utd/status/2101413427948519740采集于 2026.09.20 10:08