gemma-4-31B-it

Gemma‑4‑31B‑it is the flagship dense model of the entire lineup, which at the time of its release sets a new standard for quality and performance in the class of open models of comparable size. With 30.7 billion parameters, a deep architecture of 60 layers, and a 256‑thousand‑token context window, this model demonstrates high‑quality reasoning generation and programming skills, only slightly trailing the largest closed‑source and open‑source “giants.” Its architecture is based on a hybrid attention mechanism that alternates a local sliding window of 1024 tokens with full global layers to preserve context. To handle long sequences, the global layers use unified keys and values as well as proportional rotary position encoding (Proportional RoPE). These optimisations reduce KV cache requirements by up to 74% compared to traditional full‑attention mechanisms. The model is multimodal out‑of‑the‑box, processing text and images through a powerful vision encoder with ~550 million parameters.

According to the official developer blog, at launch Gemma‑4‑31B‑it ranks 3rd on the global Arena AI text leaderboard for open models and confidently outperforms models that are 20 times larger. The model achieves excellent results across a range of key benchmarks. On MMLU‑Pro it scores 85.2%, a significant improvement over Gemma‑3 27B’s 67.6%. The progress in reasoning and programming is even more striking: on LiveCodeBench the result nearly tripled — from 29.1% to 80.0%, and on the challenging mathematics test AIME 2026 the model achieves 89.2% versus 20.8% for its predecessor. On multimodal understanding tasks, the model also shows strong results: MMMU — 76.9%, MATH‑Vision — 85.6%.

Developers recommend the 31B model for scenarios that require high, proven generation quality and deep logical analysis, provided sufficient computational resources are available. Thanks to the Apache 2.0 licence, the model can be freely fine‑tuned and used in commercial products. The unquantised bfloat16 version fits on a single NVIDIA H100 with 80 GB of memory, while quantised variants can run efficiently on consumer GPUs, opening up opportunities for local deployment of powerful agentic systems and assistants.

For the developers’ usage recommendations for the model, please refer to this link: https://ai.google.dev/gemma/docs/core/model_card_4?hl=en

Announce Date: 11.03.2026
Parameters: 33B
Context: 263K
Layers: 60, using full attention: 10
Attention Type: Sliding Window Attention
Developer: Google DeepMind
Transformers Version: 5.5.0.dev0
vLLM Version: gemma4
License: Apache 2.0

Use our pre-built public endpoints for free to test inference and explore gemma-4-31B-it capabilities. You can obtain an API access token on the token management page after registration and verification.

Rent your own physically dedicated instance with hourly or long-term monthly billing.

We recommend deploying private instances in the following scenarios:

• maximize endpoint performance,
• enable full context for long sequences,
• ensure top-tier security for data processing in an isolated, dedicated environment,
• use custom weights, such as fine-tuned models or LoRA adapters.

Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.