Building an SLO-aware inference router with Jev

Zeeshan @zeeshan_utdOriginally posted 2026.09.20

Open original on X

Built an SLO-aware inference router using Jev It uses Jev as a typed decision model to select the optimal LLM for each request based on predicted quality, latency, cost, and live backend load Releasing full walkthrough video soon