Ollama 式本地跑 Jev 决策模型：Laya 实测 8–10ms

nokia @Kia_kkk2004原推发布于 2026.09.27

在 X 上打开原推

Ollama just got a new job run decision models locally Ollaya is basically bringing the Ollama idea to Jev-style decision models text or JSON in typed decision out no token-by-token generation Laya reports ~8–10ms for 5 questions on an RTX 4090 but here’s the catch Jev’s API is already so cheap that I’ve been using it a lot and still haven’t burned through my $5 so local isn’t automatically better the interesting part is that decision models are becoming something you can run, own and customize yourself LLMs had their Ollama moment decision models might be having theirs now