DiffusionGemma: Google’s Diffusion-Based Open Model for Faster Text Generation

Large language models usually generate text one token at a time. While this autoregressive approach delivers strong quality and instruction following, it can be inefficient for local users because GPUs often spend more time moving weights from memory than doing parallel compute. Google DeepMind’s DiffusionGemma takes a different path, generating and refining blocks of tokens in parallel using diffusion-style text generation. In this article, we’ll explore how DiffusionGemma works, how it performs, and how developers can run it locally. What is DiffusionGemma? Hands-on: Running DiffusionGemma Locally with llama.cpp What is DiffusionGemma? DiffusionGemma is Google DeepMind’s experimental open-weight model for diffusion-based text generation, built on the Gemma 4 26B A4B MoE foundation. Unlike standard LLMs that write one token at a time, it generates and refines blocks of tokens in parallel. It behaves more like a drafting system than a typewriter: refining uncertain tokens until…