What is Decision 3.0? vLLM Semantic Router’s New Open Decision Models
The vLLM Semantic Router team has released Decision 3.0 , a family of multimodal decision models. Decision 3.0 multimodal decision models read text, JSON and images, then answer typed questions about them. There are 5 sizes, from 0.8B to 27B, all under Apache-2.0. For developers, this is a fast way to classify, route and gate requests without parsing generated text. TL;DR Size: 5 models: d3-lite (0.85B), d3-nano (2.21B), d3-mini (4.54B), d3-flash (8.39B), d3 (26.09B). Context length: not disclosed. Runs on: latency measured on 1 AMD Instinct MI325X GPU. BF16 weights; no official quantized variants listed. Performance: the 27B d3 leads both the text and vision tables in its card, but on internal evaluation. Best: 97.7 on KIE (CORD+FUNSD) document extraction (d3). Worst: 34.1 on R-Bench-M (d3). Bottom line: Best: a 9B model now beats last generation’s 27B. Worst: scores are self-reported against live board data. What is Decision...
