gemma-3-4b-it

multimodal

Gemma 3 4B is a compact AI model developed by Google DeepMind, offering an excellent balance between size and functionality. Unlike the base 1B version, the 4B model supports multimodal inputs: text, images (with resolution up to 896x896 pixels), and short videos. For example, the model can recognize objects and text in images, such as extracting data from receipts or labels. To process images, it uses the SigLIP visual encoder, which automatically segments large files.

Its innovative architecture and efficient 5:1 ratio of local-to-global attention optimize memory usage while supporting a context window of up to 128K tokens. Gemma 3 4B supports 35 languages, including Russian. The model also includes function calling capabilities, enabling integration with APIs for task automation, such as generating SQL queries or transforming data.

This model is ideal for creating intelligent assistants and for fast document and image processing, making it a perfect choice for developers who need multimodal capabilities without requiring significant computational resources.


Announce Date: 12.03.2025
Parameters: 4B
Context: 132K
Layers: 34, using full attention: 5
Attention Type: Sliding Window Attention
Developer: Google DeepMind
Transformers Version: 4.50.0.dev0
License: gemma

Public endpoint

Use our pre-built public endpoints for free to test inference and explore gemma-3-4b-it capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link
There are no public endpoints for this model yet.

Private server

Rent your own physically dedicated instance with hourly or long-term monthly billing.

We recommend deploying private instances in the following scenarios:

  • maximize endpoint performance,
  • enable full context for long sequences,
  • ensure top-tier security for data processing in an isolated, dedicated environment,
  • use custom weights, such as fine-tuned models or LoRA adapters.

Recommended server configurations for hosting gemma-3-4b-it

Prices:
Name GPU Price, hour TPS Max Concurrency
teslat4-1.16.16.160
131,072.0
1 $0.33 1.661 Launch
teslaa2-1.16.32.160
131,072.0
1 $0.38 1.672 Launch
teslaa10-1.16.32.160
131,072.0
1 $0.53 3.737 Launch
rtx2080ti-2.12.64.160
131,072.0
tensor
2 $0.69 2.438 Launch
rtx3090-1.16.24.160
131,072.0
1 $0.83 4.014 Launch
rtx3080-2.16.32.160
131,072.0
tensor
2 $0.97 1.942 Launch
rtx4090-1.16.32.160
131,072.0
1 $1.02 4.003 Launch
rtxa5000-2.16.64.160.nvlink
131,072.0
tensor
2 $1.23 8.681 Launch
rtx5090-1.16.64.160
131,072.0
1 $1.59 6.050 Launch
teslaa100-1.16.64.160
131,072.0
1 $2.37 18.572 Launch
h100-1.16.64.160
131,072.0
1 $3.83 18.553 Launch
h100nvl-1.16.96.160
131,072.0
1 $4.11 22.189 Launch
teslaa100-2.24.96.160.nvlink
131,072.0
tensor
2 $4.61 38.350 Launch
h200-1.16.128.160
131,072.0
1 $4.74 34.400 Launch
h200-2.24.256.160.nvlink
131,072.0
tensor
2 $9.40 70.007 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslat4-1.16.16.160
131,072.0
1 $0.33 1.441 Launch
teslaa2-1.16.32.160
131,072.0
1 $0.38 1.452 Launch
teslaa10-1.16.32.160
131,072.0
1 $0.53 3.517 Launch
rtx2080ti-2.12.64.160
131,072.0
tensor
2 $0.69 2.218 Launch
rtx3090-1.16.24.160
131,072.0
1 $0.83 3.794 Launch
rtx3080-2.16.32.160
131,072.0
tensor
2 $0.97 1.722 Launch
rtx4090-1.16.32.160
131,072.0
1 $1.02 3.783 Launch
rtxa5000-2.16.64.160.nvlink
131,072.0
tensor
2 $1.23 8.461 Launch
rtx5090-1.16.64.160
131,072.0
1 $1.59 5.830 Launch
teslaa100-1.16.64.160
131,072.0
1 $2.37 18.352 Launch
h100-1.16.64.160
131,072.0
1 $3.83 18.333 Launch
h100nvl-1.16.96.160
131,072.0
1 $4.11 21.969 Launch
teslaa100-2.24.96.160.nvlink
131,072.0
tensor
2 $4.61 38.130 Launch
h200-1.16.128.160
131,072.0
1 $4.74 34.180 Launch
h200-2.24.256.160.nvlink
131,072.0
tensor
2 $9.40 69.787 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-1.16.32.160
131,072.0
1 $0.53 38.230 2.668 Launch
teslat4-2.16.32.160
131,072.0
tensor
2 $0.54 3.461 Launch
teslaa2-2.16.32.160
131,072.0
tensor
2 $0.57 3.482 Launch
rtx2080ti-2.12.64.160
131,072.0
tensor
2 $0.69 1.370 Launch
rtx3090-1.16.24.160
131,072.0
1 $0.83 2.945 Launch
rtx4090-1.16.32.160
131,072.0
1 $1.02 2.935 Launch
rtxa5000-2.16.64.160.nvlink
131,072.0
tensor
2 $1.23 7.612 Launch
rtx3080-3.16.64.160
131,072.0
pipeline
3 $1.43 2.314 Launch
rtx5090-1.16.64.160
131,072.0
1 $1.59 4.982 Launch
rtx3080-4.16.64.160
131,072.0
tensor
4 $1.82 4.022 Launch
teslaa100-1.16.64.160
131,072.0
1 $2.37 92.360 17.503 Launch
h100-1.16.64.160
131,072.0
1 $3.83 105.710 17.485 Launch
h100nvl-1.16.96.160
131,072.0
1 $4.11 21.121 Launch
teslaa100-2.24.96.160.nvlink
131,072.0
tensor
2 $4.61 37.282 Launch
h200-1.16.128.160
131,072.0
1 $4.74 33.331 Launch
h200-2.24.256.160.nvlink
131,072.0
tensor
2 $9.40 68.938 Launch

Related models

Need help?

Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.