Qwen2.5-72B is the flagship open-weight model of the series, featuring 72 billion parameters, 80 layers, and a 64/8 attention head architecture, representing the pinnacle of Alibaba's open-source language model capabilities. The model supports a 128K-token context window with 8K-token generation, enabling it to analyze multiple documents and produce detailed content with exceptional accuracy.
Trained on an extended dataset of 18 trillion tokens with enhanced filtering and specialized data in mathematics and programming, Qwen2.5-72B delivers outstanding performance across a wide range of tasks. Its most remarkable feature is achieving state-of-the-art results among open-weight models while being significantly smaller than competitors. According to the technical report, the model demonstrates performance competitive with Llama-3-405B-Instruct, despite being five times smaller in size.
Distributed under the special Qwen Research License, Qwen2.5-72B is designed for projects requiring the highest quality natural language processing. The model is ideally suited for: fundamental AI research, development of cutting-edge AI products, training and fine-tuning specialized models, serving as a foundation for multimodal systems and building advanced AI agents
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.
A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.
We recommend creating private endpoints when you need to:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 pipeline |
3 | $1.34 | 1.743 | Launch | ||
32,768.0 tensor |
4 | $1.62 | 3.711 | Launch | ||
32,768.0 pipeline |
6 | $1.65 | 2.811 | Launch | ||
32,768.0 pipeline |
3 | $2.29 | 20.33 | 2.031 | Launch | |
32,768.0 |
1 | $2.37 | 31.78 | 3.239 | Launch | |
32,768.0 pipeline |
3 | $2.83 | 22.35 | 2.021 | Launch | |
32,768.0 tensor |
4 | $2.89 | 4.101 | Launch | ||
32,768.0 tensor |
2 | $2.93 | 1.544 | Launch | ||
32,768.0 tensor |
4 | $3.01 | 4.101 | Launch | ||
32,768.0 tensor |
4 | $3.60 | 4.086 | Launch | ||
32,768.0 |
1 | $3.83 | 3.232 | Launch | ||
32,768.0 |
1 | $4.11 | 4.512 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 47.08 | 10.357 | Launch | |
32,768.0 |
1 | $4.74 | 8.809 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 21.499 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $4.12 | 28.34 | 1.018 | Launch | |
32,768.0 |
1 | $4.74 | 5.316 | Launch | ||
32,768.0 tensor |
2 | $4.93 | 34.19 | 7.040 | Launch | |
32,768.0 tensor |
2 | $4.94 | 7.040 | Launch | ||
32,768.0 tensor |
4 | $5.76 | 2.914 | Launch | ||
32,768.0 pipeline |
6 | $5.84 | 3.126 | Launch | ||
32,768.0 tensor |
8 | $6.04 | 7.281 | Launch | ||
32,768.0 tensor |
8 | $7.52 | 7.252 | Launch | ||
32,768.0 tensor |
2 | $7.85 | 36.33 | 6.921 | Launch | |
32,768.0 tensor |
2 | $9.41 | 17.818 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 pipeline |
3 | $7.36 | 7.047 | Launch | ||
32,768.0 tensor |
8 | $7.52 | 1.032 | Launch | ||
32,768.0 tensor |
2 | $8.17 | 42.08 | 2.902 | Launch | |
32,768.0 tensor |
4 | $9.14 | 14.253 | Launch | ||
32,768.0 tensor |
2 | $9.41 | 11.497 | Launch | ||
32,768.0 tensor |
2 | $9.41 | 11.497 | Launch | ||
32,768.0 tensor |
4 | $9.50 | 14.253 | Launch | ||
32,768.0 tensor |
8 | $11.55 | 6.795 | Launch | ||
32,768.0 pipeline |
3 | $11.73 | 7.028 | Launch | ||
32,768.0 tensor |
4 | $14.96 | 14.228 | Launch | ||
Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.