Ministral-3-8B-Instruct-2512

multimodal

The Ministral-3-8B-Instruct-2512 strikes the sweet spot in the Ministral 3 family, offering an optimal balance between computational efficiency and response quality. Its architecture includes a text LLM with 8.4 billion parameters and a vision encoder with 0.4 billion parameters. The model is provided by its developers in an FP8 quantized format. A context window of 256,000 tokens enables processing large volumes of information, and the Apache 2.0 license permits free commercial use.

The Cascade Distillation technology underlying Ministral 3 allows the 8B model to retain a significant portion of the capabilities of its parent model, Mistral Small 3.1 (24B), while reducing parameters by nearly three times. This is achieved through iterative pruning followed by knowledge distillation, which substantially lowers training computational costs without meaningful quality loss. The 410M‑parameter vision encoder works in tandem with an adapter, providing efficient multimodal perception with minimal overhead.

On the Arena Hard benchmark (instruction-following evaluation), the model scores 0.509, which is comparable to Qwen3-VL-8B-Instruct (0.528) and higher than Gemma3-12B-Instruct (0.436). On WildBench (dialogue capabilities), its result of 66.8 surpasses Qwen3-VL-8B-Instruct (66.3). On the MATH Maj@1 benchmark, the model achieves 0.876, demonstrating strong analytical abilities at a relatively compact size.

When using the model, developers are advised to clearly define the environment and use case in the system prompt. Use a temperature below 0.1 for productive environments and minimize the number of tools in agentic scenarios. For visual input, use images with an aspect ratio close to 1:1. The model is well‑suited for local AI assistants and chat interfaces in constrained environments, as well as for image/document description, translation and content generation, and specialized agentic scenarios.


Announce Date: 31.10.2025
Parameters: 9B
Context: 263K
Layers: 34
Attention Type: Full Attention
Developer: Mistral AI
Transformers Version: 5.0.0.dev0
License: Apache 2.0

Public endpoint

Use our pre-built public endpoints for free to test inference and explore Ministral-3-8B-Instruct-2512 capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link
There are no public endpoints for this model yet.

Private server

Rent your own physically dedicated instance with hourly or long-term monthly billing.

We recommend deploying private instances in the following scenarios:

  • maximize endpoint performance,
  • enable full context for long sequences,
  • ensure top-tier security for data processing in an isolated, dedicated environment,
  • use custom weights, such as fine-tuned models or LoRA adapters.

Recommended server configurations for hosting Ministral-3-8B-Instruct-2512

Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa2-4.32.128.160
262,144.0
tensor
4 $1.26 1.261 Launch
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 1.440 Launch
rtx3090-2.16.64.160
262,144.0
tensor
2 $1.56 1.014 Launch
rtx3090-2.16.64.160.nvlink
262,144.0
tensor
2 $1.56 1.014 Launch
teslaa10-4.12.48.160
262,144.0
tensor
4 $1.57 2.116 Launch
rtx4090-2.16.64.160
262,144.0
tensor
2 $1.92 229.67 1.012 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 175.96 1.917 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.435 Launch
h100-1.16.64.160
262,144.0
1 $3.83 1.910 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 2.287 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 4.028 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.550 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 7.304 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa2-4.32.128.160
262,144.0
tensor
4 $1.26 1.182 Launch
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 1.359 Launch
teslaa10-4.12.48.160
262,144.0
tensor
4 $1.57 2.037 Launch
rtx3090-3.16.96.160
262,144.0
pipeline
3 $2.29 1.440 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 128.30 1.829 Launch
rtx4090-3.16.96.160
262,144.0
pipeline
3 $2.83 82.52 1.437 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 167.16 2.141 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.353 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 2.141 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 190.56 2.148 Launch
h100-1.16.64.160
262,144.0
1 $3.83 1.827 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 247.08 2.203 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.946 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.467 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 7.222 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 1.126 Launch
teslaa10-4.16.64.160
262,144.0
tensor
4 $1.62 1.814 Launch
teslaa2-6.32.128.160
262,144.0
pipeline
6 $1.65 1.587 Launch
rtx3090-3.16.96.160
262,144.0
pipeline
3 $2.29 1.207 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 58.90 1.617 Launch
rtx4090-3.16.96.160
262,144.0
pipeline
3 $2.83 53.93 1.205 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 127.62 1.929 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.113 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 1.929 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 1.925 Launch
h100-1.16.64.160
262,144.0
1 $3.83 1.577 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 1.954 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.705 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.218 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 6.982 Launch

Related models

Need help?

Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.

We use cookies and web analytics services to ensure the proper functioning of the website, analyze web-site traffic, and improve the quality of our services.
By continuing to use the website, you consent to the Privacy Policy and consent to the processing of cookie files and technical data.