Meet qwenGPU: Qwen3.5-2B With 45 Compiled GPU Layers That Run CUDA
qwenGPU is an experimental model that compiles a SIMT GPU directly into the weights of Qwen3.5-2B . Developer Vixhal ( @TheVixhal ) released it on GitHub under the MIT license. The model runs real CUDA, compiled to NVIDIA PTX, inside its own forward passes. For developers, it tests one idea: exact computation inside a pretrained LLM, not beside it. TL;DR Size: Qwen3.5-2B (24 layers) along with 45 compiled GPU layers, 69 in total. Context: 262,144 tokens (base model). Runs on: Apple silicon, an NVIDIA GPU or a CPU, with about 16 GB of free memory. No quantized build. Performance: Every launch in the developer’s runs was exact; text drift is a KL of about 7e-4. Best: The reference interpreter matched a real NVIDIA Tesla T4 on 49 of 49 kernels. Worst: About 10 to 15 tokens per second on Apple MPS; Qwen-written CUDA passed 4 of 5. What is qwenGPU? qwenGPU is Qwen3.5-2B with 45 compiled transformer layers placed in front of Qwen’s own 24...
