WHAT NEW IN X11.04 WED

X 上的 AI 合集档案 · 22 个合集 · 66,612 条

jevIMAGE

用 Jev 做模型路由:按任务难度分三档派发

作者用 Jev 当调度器,把查询分成快/标准/推理三档,分别路由到小模型、中型模型和强模型,以降低延迟和成本。

Slonski
@Slonski_rt2026.09.23收录原推发布于 2026.09.23
用 Jev 做模型路由:按任务难度分三档派发
Slonski @Slonski_rt原推发布于 2026.09.23
在 X 上打开原推

every task on your stack runs through the same model typo fixes and deep synthesis get the same compute bill that is the waste nobody notices until the bill does i am implementing a model router using jev as the dispatcher three buckets: - fast track: typos, json formatting, basic extraction → llama 3 8b or phi-3 - standard track: short posts, summarization, simple contradictions → mistral or mid-size models - reasoning track: deep synthesis, strategic planning, complex code → gemma 4 31b or claude 3.5 jev reads the query picks the bucket routes it latency drops load drops the real test is not the router it is whether output quality holds once the cheap models take the easy half

这条是引用着另一条写的:x.com/0xricker/status/2102396090012115030

x.com/slonski_rt/status/2102439508080029948采集于 2026.09.23 10:15