WHAT NEW IN X10.30 FRI

X 上的 AI 合集档案 · 22 个合集 · 61,719 条

benchmarkIMAGE

ValsAI 发布 Vals Router Index 路由器评测

ValsAI 用约 1250 个金融、编程、法律、税务任务评测五款模型路由器,发现每个路由器都在分数和成本上被单一模型击败。

Vals AI
@ValsAI9 天前收录原推发布于 2026.10.21
ValsAI 发布 Vals Router Index 路由器评测
Vals AI @ValsAI原推发布于 2026.10.21
在 X 上打开原推

How do model routers compare to individual models on real agentic tasks? Introducing the Vals Router Index. Routers promise to balance quality and cost across a fast-moving model frontier. We put that promise to the test with an independent evaluation of five routers (OpenRouter Auto, FireRouter, Ramp Router, Jev, Fugu Max) against every single model on the Vals Index, using the same agents, ~1,250 tasks and graders across finance, coding, law and tax. We found that routing didn’t consistently deliver better value. Every router was beaten on both score and cost by at least one single model.

x.com/valsai/status/2112624419923440095采集于 2026.10.21 10:22