Jev 做模型路由：延迟降 95%、成本降 5 倍

Ivan Zhou @ivanzhouyq原推发布于 2026.09.17

在 X 上打开原推

I tried @typesafeai’s Jev on a few model-routing tasks and was really impressed by its speed: 95% lower latency than GPT-5.6 Luna, at 5× lower cost. It is fast enough to run inline during an agent session, monitoring every turn and dynamically switching models when needed. Such latency unlocks a new class of real-time, adaptive agent experiences!