The Ministral-3-8B-Instruct-2512 strikes the sweet spot in the Ministral 3 family, offering an optimal balance between computational efficiency and response quality. Its architecture includes a text LLM with 8.4 billion parameters and a vision encoder with 0.4 billion parameters. The model is provided by its developers in an FP8 quantized format. A context window of 256,000 tokens enables processing large volumes of information, and the Apache 2.0 license permits free commercial use.
The Cascade Distillation technology underlying Ministral 3 allows the 8B model to retain a significant portion of the capabilities of its parent model, Mistral Small 3.1 (24B), while reducing parameters by nearly three times. This is achieved through iterative pruning followed by knowledge distillation, which substantially lowers training computational costs without meaningful quality loss. The 410M‑parameter vision encoder works in tandem with an adapter, providing efficient multimodal perception with minimal overhead.
On the Arena Hard benchmark (instruction-following evaluation), the model scores 0.509, which is comparable to Qwen3-VL-8B-Instruct (0.528) and higher than Gemma3-12B-Instruct (0.436). On WildBench (dialogue capabilities), its result of 66.8 surpasses Qwen3-VL-8B-Instruct (66.3). On the MATH Maj@1 benchmark, the model achieves 0.876, demonstrating strong analytical abilities at a relatively compact size.
When using the model, developers are advised to clearly define the environment and use case in the system prompt. Use a temperature below 0.1 for productive environments and minimize the number of tools in agentic scenarios. For visual input, use images with an aspect ratio close to 1:1. The model is well‑suited for local AI assistants and chat interfaces in constrained environments, as well as for image/document description, translation and content generation, and specialized agentic scenarios.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
Rent your own physically dedicated instance with hourly or long-term monthly billing.
We recommend deploying private instances in the following scenarios:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
262,144.0 tensor |
4 | $0.96 | 1.197 | Launch | ||
262,144.0 tensor |
4 | $1.26 | 1.197 | Launch | ||
262,144.0 pipeline |
3 | $1.34 | 1.482 | Launch | ||
262,144.0 tensor |
4 | $1.57 | 2.044 | Launch | ||
262,144.0 pipeline |
3 | $2.29 | 1.482 | Launch | ||
262,144.0 tensor |
4 | $2.34 | 2.044 | Launch | ||
262,144.0 |
1 | $2.37 | 1.841 | Launch | ||
262,144.0 pipeline |
3 | $2.83 | 1.482 | Launch | ||
262,144.0 tensor |
4 | $2.89 | 2.044 | Launch | ||
262,144.0 tensor |
2 | $2.93 | 1.344 | Launch | ||
262,144.0 tensor |
4 | $3.60 | 2.044 | Launch | ||
262,144.0 |
1 | $3.83 | 1.841 | Launch | ||
262,144.0 |
1 | $4.11 | 2.212 | Launch | ||
262,144.0 |
1 | $4.74 | 3.456 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
262,144.0 pipeline |
3 | $1.34 | 1.114 | Launch | ||
262,144.0 tensor |
4 | $1.62 | 1.676 | Launch | ||
262,144.0 pipeline |
6 | $1.65 | 1.529 | Launch | ||
262,144.0 pipeline |
3 | $2.29 | 1.114 | Launch | ||
262,144.0 tensor |
4 | $2.34 | 1.676 | Launch | ||
262,144.0 |
1 | $2.37 | 1.473 | Launch | ||
262,144.0 pipeline |
3 | $2.83 | 1.114 | Launch | ||
262,144.0 tensor |
4 | $2.89 | 1.676 | Launch | ||
262,144.0 tensor |
2 | $2.93 | 0.976 | Launch | ||
262,144.0 tensor |
4 | $3.60 | 1.676 | Launch | ||
262,144.0 |
1 | $3.83 | 1.473 | Launch | ||
262,144.0 |
1 | $4.11 | 1.844 | Launch | ||
262,144.0 |
1 | $4.74 | 3.088 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
262,144.0 pipeline |
6 | $1.65 | 1.123 | Launch | ||
262,144.0 tensor |
4 | $1.75 | 1.270 | Launch | ||
262,144.0 tensor |
4 | $2.34 | 1.270 | Launch | ||
262,144.0 |
1 | $2.50 | 1.067 | Launch | ||
262,144.0 tensor |
4 | $2.97 | 1.270 | Launch | ||
262,144.0 tensor |
4 | $3.68 | 1.270 | Launch | ||
262,144.0 |
1 | $3.95 | 1.067 | Launch | ||
262,144.0 |
1 | $4.11 | 1.438 | Launch | ||
262,144.0 pipeline |
3 | $4.34 | 1.343 | Launch | ||
262,144.0 |
1 | $4.74 | 2.682 | Launch | ||
262,144.0 tensor |
4 | $5.74 | 2.117 | Launch | ||
Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.