Llama 4 Scout

multimodal

Llama 4 Scout is the lightest model in the next generation of the Llama 4 family, released on April 5, 2025. Llama 4 scout has a MoE architecture of 16 experts, 109 billion of which only 17 billion are permanently active. The model supports native multimodality. It is capable of simultaneously processing text and up to 5 images as input, allowing it to be used effectively in computer vision tasks such as object recognition, image description, and image-based question answering. Creative text generation, step-by-step reasoning, and programming are also among the model's strengths

That said, Llama scout can run efficiently on just a single H100 GPU, making it attractive for local deployment, and with more parameters, Llama scout outperforms lighter weight models in the segment on benchmarks.

But perhaps the most important feature of the model is its record-breaking context window support of up to 10 million tokens! which makes it ideal for working with large documents, code, multi-page queries and lengthy dialog sessions.


Announce Date: 05.04.2025
Parameters: 109B
Experts: 16
Activated at inference: 17B
Context: 10486K
Layers: 48, using full attention: 12
Attention Type: Chunked Attention
Developer: Meta AI
Transformers Version: 4.51.0
vLLM Version: 0.8.3
License: LLAMA 4

Public endpoint

Use our pre-built public endpoints for free to test inference and explore Llama 4 Scout capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link
There are no public endpoints for this model yet.

Private server

Rent your own physically dedicated instance with hourly or long-term monthly billing.

We recommend deploying private instances in the following scenarios:

  • maximize endpoint performance,
  • enable full context for long sequences,
  • ensure top-tier security for data processing in an isolated, dedicated environment,
  • use custom weights, such as fine-tuned models or LoRA adapters.

Recommended server configurations for hosting Llama 4 Scout

Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa2-6.32.128.160
250,000.0
pipeline
6 $1.65 0.031 Launch
teslaa10-4.16.128.160
250,000.0
tensor
4 $1.75 0.042 Launch
rtxa5000-4.16.128.160.nvlink
250,000.0
tensor
4 $2.34 0.042 Launch
rtx3090-4.16.96.320
250,000.0
tensor
4 $2.97 0.042 Launch
rtx4090-4.16.96.320
250,000.0
tensor
4 $3.68 0.042 Launch
teslav100-3.64.256.320
250,000.0
pipeline
3 $3.89 0.047 Launch
h100nvl-1.16.96.160
250,000.0
1 $4.11 0.054 Launch
rtx5090-3.16.96.160
250,000.0
pipeline
3 $4.34 0.047 Launch
teslav100-4.32.96.160
250,000.0
tensor
4 $4.35 0.101 Launch
teslaa100-2.24.96.160.nvlink
250,000.0
tensor
2 $4.61 0.172 Launch
h200-1.16.128.160
250,000.0
1 $4.74 0.141 Launch
rtx5090-4.16.128.160
250,000.0
tensor
4 $5.74 0.101 Launch
h100-2.24.256.160
250,000.0
tensor
2 $7.84 61.600 0.172 Launch
teslaa100-8.44.704.160.nvlink
10,485,760.0
tensor
8 $18.69 1.036 Launch
h200-6.52.896.640
10,485,760.0
pipeline
6 $28.36 1.431 Launch
h200-8.52.1024.640
10,485,760.0
tensor
8 $37.34 1.947 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
h200-1.16.128.240
250,000.0
1 $4.74 0.042 Launch
teslaa100-2.24.256.240
250,000.0
tensor
2 $4.93 0.073 Launch
rtx4090-8.44.256.240
250,000.0
tensor
8 $7.52 0.101 Launch
h100-2.24.256.240
250,000.0
tensor
2 $7.85 0.073 Launch
h100nvl-2.24.192.240
250,000.0
tensor
2 $8.17 0.125 Launch
rtx5090-6.44.256.240
250,000.0
pipeline
6 $8.86 0.112 Launch
rtx5090-8.44.256.240
250,000.0
tensor
8 $11.55 0.221 Launch
h200-6.52.896.640
10,485,760.0
pipeline
6 $28.36 1.332 Launch
h200-8.52.1024.640
10,485,760.0
tensor
8 $37.34 1.848 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa100-4.16.256.480
250,000.0
tensor
4 $9.17 0.126 Launch
h200-2.24.256.320
250,000.0
tensor
2 $9.42 0.066 Launch
h100nvl-3.24.384.480
250,000.0
pipeline
3 $12.38 0.061 Launch
h100-4.16.256.480
250,000.0
tensor
4 $14.99 0.126 Launch
h100nvl-4.32.384.480
250,000.0
tensor
4 $16.23 0.231 Launch
h200-6.52.896.640
10,485,760.0
pipeline
6 $28.36 1.098 Launch
h200-8.52.1024.640
10,485,760.0
tensor
8 $37.34 1.613 Launch

Related models

Need help?

Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.