Qwen2.5-72B is the flagship open-weight model of the series, featuring 72 billion parameters, 80 layers, and a 64/8 attention head architecture, representing the pinnacle of Alibaba's open-source language model capabilities. The model supports a 128K-token context window with 8K-token generation, enabling it to analyze multiple documents and produce detailed content with exceptional accuracy.
Trained on an extended dataset of 18 trillion tokens with enhanced filtering and specialized data in mathematics and programming, Qwen2.5-72B delivers outstanding performance across a wide range of tasks. Its most remarkable feature is achieving state-of-the-art results among open-weight models while being significantly smaller than competitors. According to the technical report, the model demonstrates performance competitive with Llama-3-405B-Instruct, despite being five times smaller in size.
Distributed under the special Qwen Research License, Qwen2.5-72B is designed for projects requiring the highest quality natural language processing. The model is ideally suited for: fundamental AI research, development of cutting-edge AI products, training and fine-tuning specialized models, serving as a foundation for multimodal systems and building advanced AI agents
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
Rent your own physically dedicated instance with hourly or long-term monthly billing.
We recommend deploying private instances in the following scenarios:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 pipeline |
3 | $1.34 | 1.610 | Launch | ||
32,768.0 tensor |
4 | $1.62 | 3.520 | Launch | ||
32,768.0 pipeline |
6 | $1.65 | 3.020 | Launch | ||
32,768.0 tensor |
2 | $2.22 | 1.140 | Launch | ||
32,768.0 pipeline |
3 | $2.29 | 1.610 | Launch | ||
32,768.0 tensor |
4 | $2.34 | 3.520 | Launch | ||
32,768.0 |
1 | $2.37 | 2.830 | Launch | ||
32,768.0 pipeline |
3 | $2.83 | 1.610 | Launch | ||
32,768.0 tensor |
4 | $2.89 | 3.520 | Launch | ||
32,768.0 tensor |
2 | $2.93 | 1.140 | Launch | ||
32,768.0 tensor |
4 | $3.60 | 3.520 | Launch | ||
32,768.0 |
1 | $3.83 | 2.830 | Launch | ||
32,768.0 |
1 | $4.11 | 4.090 | Launch | ||
32,768.0 |
1 | $4.74 | 8.320 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 pipeline |
6 | $3.50 | 4.689 | Launch | ||
32,768.0 pipeline |
3 | $3.89 | 1.119 | Launch | ||
32,768.0 |
1 | $4.11 | 1.439 | Launch | ||
32,768.0 pipeline |
3 | $4.34 | 1.119 | Launch | ||
32,768.0 tensor |
4 | $4.35 | 3.749 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 7.129 | Launch | ||
32,768.0 tensor |
8 | $4.61 | 8.509 | Launch | ||
32,768.0 |
1 | $4.74 | 5.669 | Launch | ||
32,768.0 tensor |
4 | $5.74 | 3.749 | Launch | ||
32,768.0 pipeline |
6 | $5.83 | 4.689 | Launch | ||
32,768.0 tensor |
8 | $7.51 | 8.509 | Launch | ||
32,768.0 tensor |
2 | $7.84 | 7.129 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 pipeline |
3 | $7.36 | 6.299 | Launch | ||
32,768.0 tensor |
2 | $8.17 | 1.869 | Launch | ||
32,768.0 pipeline |
6 | $8.86 | 1.229 | Launch | ||
32,768.0 tensor |
4 | $9.14 | 13.249 | Launch | ||
32,768.0 tensor |
2 | $9.41 | 10.329 | Launch | ||
32,768.0 tensor |
8 | $11.55 | 6.489 | Launch | ||
32,768.0 pipeline |
3 | $11.73 | 6.299 | Launch | ||
32,768.0 tensor |
4 | $14.96 | 13.249 | Launch | ||
Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.