WHAT NEW IN X10.30 FRI

AI collections from X · 22 collections · 61,986 posts

benchmarkIMAGE

ValsAI launches Vals Router Index benchmarking five model routers

ValsAI evaluated five model routers on ~1,250 finance, coding, law and tax tasks and found each was beaten on both score and cost by at least one single model.

Vals AI
@ValsAIArchived 9 days agoOriginally posted 2026.10.21
ValsAI launches Vals Router Index benchmarking five model routers
Vals AI @ValsAIOriginally posted 2026.10.21
Open original on X

How do model routers compare to individual models on real agentic tasks? Introducing the Vals Router Index. Routers promise to balance quality and cost across a fast-moving model frontier. We put that promise to the test with an independent evaluation of five routers (OpenRouter Auto, FireRouter, Ramp Router, Jev, Fugu Max) against every single model on the Vals Index, using the same agents, ~1,250 tasks and graders across finance, coding, law and tax. We found that routing didn’t consistently deliver better value. Every router was beaten on both score and cost by at least one single model.

x.com/valsai/status/2112624419923440095Archived 2026.10.21 10:22