WHAT NEW IN X11.01 SUN

AI collections from X · 22 collections · 63,170 posts

jevIMAGE

vLLM Semantic Router releases Decision 3.0 model family

Five open multimodal decision models from 0.8B to 27B return probability scores for Choice, Yes/No and Score questions in one call, with the 9B d3-flash scoring 59.0 on the Jev Decision Index, above Decision 2.0's 27B.

Marktechpost AI
@MarktechpostArchived 19 days agoOriginally posted 2026.10.12
vLLM Semantic Router releases Decision 3.0 model family
Marktechpost AI @MarktechpostOriginally posted 2026.10.12
Open original on X

vLLM Semantic Router's Decision 3.0, a family of 5 open multimodal decision models from 0.8B to 27B. They read text, JSON and images, then answer typed questions in 1 call, returning a probability for every answer instead of generating text. The core idea is “system one” decisions for routers and guardrails. You pass a state, optional images and named Choice, Yes/No or Score questions. Each question gets its own forward pass, so you get calibrated scores you can threshold, not text you have to parse. The size curve is the real story. The 9B d3-flash scores 59.0 on the Jev Decision Index, beating Decision 2.0’s 27B (55.9). The 27B d3 posts 64.1 on text and 71.6 on vision, ahead of Perplexity Decider v1.1 (62.8 and 70.6). The trade-off: those d3 scores are internal evals, and the 0.8B and 2B models don’t lead every board. Apache-2.0, built on Qwen bases, trained on AMD Instinct MI325X. Median text latency runs from 21.7 ms to 84 ms on 1 GPU. Built for routing, moderation and agent guardrails...... Full analysis: https://www.marktechpost.com/2026/10/11/what-is-decision-3-0-vllm-semantic-routers-new-open-decision-models/ Model: https://huggingface.co/collections/vllm-sr/decision-30 Repo: https://github.com/vllm-project/semantic-router @vllm_project

x.com/marktechpost/status/2109400142420099253Archived 2026.10.12 10:04