gemma-3-1b-it

Gemma 3 1B — a compact language model developed by Google DeepMind, achieving an impressive balance between size and capabilities. With just 1 billion parameters and a context window of 32,000 tokens, the model is highly efficient and capable of running on devices with limited resources. Thanks to its architecture, Gemma 3 1B optimizes memory usage, making it an ideal choice for embedded systems and mobile applications.

It's important to note that the 1B version is a text-only model and does not support image processing, unlike the larger variants in the Gemma 3 series (4B, 12B, and 27B), which offer multimodal capabilities.

Additionally, the model has limited language support and is primarily optimized for tasks in English.

Gemma 3 1B is available with open weights, making it easy to fine-tune and adapt to specific use cases. It comes in multiple quantization levels, ranging from 32-bit down to 4-bit, providing added flexibility when deploying on different hardware platforms.


Announce Date: 12.03.2025
Parameters: 1B
Context: 33K
Layers: 26, using full attention: 4
Attention Type: Sliding Window Attention
Developer: Google DeepMind
Transformers Version: 4.50.0.dev0
License: gemma

Public endpoint

Use our pre-built public endpoints for free to test inference and explore gemma-3-1b-it capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link

API access to gemma-3-1b-it endpoints

There are no public endpoints for this model yet.

Private endpoint

An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.

A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.

We recommend creating private endpoints when you need to:

  • achieve maximum endpoint performance,
  • access the full context window for processing large requests and conversations,
  • ensure maximum security by processing data in a dedicated, isolated environment.

Recommended server configurations for creating a private inference endpoint gemma-3-1b-it

Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa2-1.16.32.160
32,768.0
1 $0.38 52.19 46.484 Launch
teslaa10-1.16.32.160
32,768.0
1 $0.53 70.13 78.109 Launch
rtx3090-1.16.24.160
32,768.0
1 $0.83 85.10 82.341 Launch
rtx4090-1.16.32.160
32,768.0
1 $1.02 95.84 82.182 Launch
rtx3090-2.16.64.160.nvlink
32,768.0
tensor
2 $1.56 46.411 Launch
rtx5090-1.16.64.160
32,768.0
1 $1.59 94.31 113.484 Launch
teslaa100-1.16.64.160
32,768.0
1 $2.37 105.64 304.670 Launch
h100-1.16.64.160
32,768.0
1 $3.83 103.88 131.769 Launch
h100nvl-1.16.96.160
32,768.0
1 $4.11 205.74 144.935 Launch
teslaa100-2.24.96.160.nvlink
32,768.0
tensor
2 $4.61 268.740 Launch
h200-1.16.128.160
32,768.0
1 $4.74 228.917 Launch
h200-2.24.256.160.nvlink
32,768.0
tensor
2 $9.40 229.894 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa2-1.16.32.160
32,768.0
1 $0.38 51.26 42.492 Launch
teslaa10-1.16.32.160
32,768.0
1 $0.53 62.69 74.117 Launch
rtx3090-1.16.24.160
32,768.0
1 $0.83 80.56 78.349 Launch
rtx4090-1.16.32.160
32,768.0
1 $1.02 89.07 78.189 Launch
rtx3090-2.16.64.160.nvlink
32,768.0
tensor
2 $1.56 44.436 Launch
rtx5090-1.16.64.160
32,768.0
1 $1.59 83.91 109.492 Launch
teslaa100-1.16.64.160
32,768.0
1 $2.37 110.85 300.678 Launch
h100-1.16.64.160
32,768.0
1 $3.83 116.27 129.990 Launch
h100nvl-1.16.96.160
32,768.0
1 $4.11 260.99 143.157 Launch
teslaa100-2.24.96.160.nvlink
32,768.0
tensor
2 $4.61 266.765 Launch
h200-1.16.128.160
32,768.0
1 $4.74 227.139 Launch
h200-2.24.256.160.nvlink
32,768.0
tensor
2 $9.40 229.005 Launch

Related models

Need help?

Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.

We use cookies and web analytics services to ensure the proper functioning of the website, analyze web-site traffic, and improve the quality of our services.
By continuing to use the website, you consent to the Privacy Policy and consent to the processing of cookie files and technical data.