OpenRouter's head of insights on Jev and the rise of decision models
A fireside chat with OpenRouter's head of insights noting 12 decision models on the platform a week after Jev launched, plus agent token usage, cache hit rates and cost per task.
Last week I hosted a fireside chat with @PeterJ_Walker (Head of Insights, @OpenRouter) on the State of Models at the Open Source AI Awards. We get into: -how @OpenRouter already had 12 decision models a week after Jev launched -how the revenue quality problem for AI companies is not actually a big problem -how cache hit rates on new models jumped from 56% to 88% in a year and much, much, more… Enjoy! Timestamps 0:00 Intro 0:43 What @OpenRouter does 2:13 Joining @stripe 2:40 OpenRouter's rankings data 3:48 Agents overtake humans in token usage 5:06 Open-weight models are closing the gap 5:47 How much of the market @OpenRouter sees 7:00 How fast token usage is growing 7:54 Where the money goes: open vs. closed 9:01 Do companies spend less as they mature? 10:49 Why labs cannibalize their own models 12:07 What if open models hit 99% of tokens? 12:56 Are models becoming commodities? 14:15 The top 1% of AI spenders and the @AnthropicAI IPO 15:54 Jev and the rise of decision models 17:20 Why we're all benchmarked out 18:36 Is most AI work just classification? 19:20 Why caching keeps getting better 20:34 Cost per token vs. cost per task Link in the comments.