Llama-4-Maverick-17B-128E-Instruct

multimodal

The Llama 4 Maverick is a versatile model in the next generation of the Llama 4 family, released in April 2025. Unlike the more compact Scout, the Maverick is designed for those who need to maximize performance and processing power. The model uses MoE architecture with 128 experts, which has 400 billion parameters in total - making it one of the largest scale open source models on the market. However, only 17 billion parameters are active at each step, significantly reducing inference latency and resource requirements. Like all models in the Maverik series, Maverik supports native multimodality, making it easy to input and process images together with image support text.

With its large-scale architecture, Maverick offers consistency and depth of reasoning, accuracy and security of responses. The model performs respectably on complex logical reasoning, math, and programming tasks, outperforming previous generations of LLMs and major competitors on several key metrics.

The model incorporates advanced security features such as Llama Guard 4 (12B) to filter unsafe content and Llama Prompt Guard 2 (22M and 86M) to protect against manipulative or malicious input.

Llama 4 Maverick is ideal for complex enterprise solutions and large-scale projects where deep insight and precise execution are required.


Announce Date: 05.04.2025
Parameters: 402B
Experts: 128
Activated at inference: 17B
Context: 1049K
Layers: 48, using full attention: 12
Attention Type: Chunked Attention
Developer: Meta AI
Transformers Version: 4.51.0
License: LLAMA 4

Public endpoint

Use our pre-built public endpoints for free to test inference and explore Llama-4-Maverick-17B-128E-Instruct capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link

API access to Llama-4-Maverick-17B-128E-Instruct endpoints

There are no public endpoints for this model yet.

Private endpoint

An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.

A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.

We recommend creating private endpoints when you need to:

  • achieve maximum endpoint performance,
  • access the full context window for processing large requests and conversations,
  • ensure maximum security by processing data in a dedicated, isolated environment.

Recommended server configurations for creating a private inference endpoint Llama-4-Maverick-17B-128E-Instruct

Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa100-4.16.256.480
1,048,576.0
tensor
4 $9.17 81.40 1.653 Launch
h200-2.24.256.320
250,000.0
tensor
2 $9.42 127.50 3.440 Launch
h200-2.24.256.320.nvlink
250,000.0
tensor
2 $9.42 127.50 3.440 Launch
teslaa100-4.32.384.320.nvlink
1,048,576.0
tensor
4 $9.50 81.40 1.653 Launch
rtx5090-8.44.256.480
250,000.0
tensor
8 $11.58 1.119 Launch
h100nvl-3.24.384.480
250,000.0
pipeline
3 $12.38 3.076 Launch
h200-3.32.512.480
1,048,576.0
pipeline
3 $14.36 3.390 Launch
h100-4.16.256.320
1,048,576.0
tensor
4 $14.97 54.46 1.399 Launch
h100nvl-4.32.384.320
1,048,576.0
tensor
4 $16.22 2.590 Launch
h200-4.32.768.480
1,048,576.0
tensor
4 $19.23 5.936 Launch
h200-4.32.768.480.nvlink
1,048,576.0
tensor
4 $19.23 5.936 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa100-6.44.512.960.nvlink
250,000.0
pipeline
6 $14.15 2.021 Launch
teslaa100-8.44.704.960.nvlink
1,048,576.0
tensor
8 $18.78 3.377 Launch
h200-4.32.768.640
1,048,576.0
tensor
4 $19.25 141.75 2.193 Launch
h200-4.32.768.640.nvlink
1,048,576.0
tensor
4 $19.25 141.75 2.193 Launch
dedicated-h100-8.96.768.5760-1.nvlink
1,048,576.0
tensor
8 $31.39 81.00 3.256 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
h200-8.52.1024.960
1,048,576.0
tensor
8 $37.37 4.935 Launch
h200-8.52.1024.960.nvlink
1,048,576.0
tensor
8 $37.37 4.935 Launch

Related models

Need help?

Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.

We use cookies and web analytics services to ensure the proper functioning of the website, analyze web-site traffic, and improve the quality of our services.
By continuing to use the website, you consent to the Privacy Policy and consent to the processing of cookie files and technical data.