Qwen2.5-32B features 32 billion parameters, 64 layers, and a 40/8 attention head architecture, representing a significant leap in computational power and model capabilities. With support for a 128K-token context window and 8K-token generation capacity, the model can handle exceptionally complex and large-scale tasks.
Qwen2.5-32B reintroduces the 32B parameter size to the Qwen series after its absence in Qwen2, offering users a powerful alternative to the flagship 72B model with lower resource requirements. Trained on 18 trillion high-quality tokens, the model demonstrates robust performance with large datasets, expert-level knowledge in specialized domains, superior abstract reasoning capabilities, and the ability to solve problems requiring deep contextual understanding and multi-step analysis.
Qwen2.5-32B is designed for organizations and research teams that need frontier-model capabilities without the full cost of the largest models. Ideal applications include scientific research, complex software development, high-quality content creation, expert support systems in medicine and law, and as a foundation for building highly specialized AI systems.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.
A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.
We recommend creating private endpoints when you need to:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 tensor |
2 | $0.93 | 2.508 | Launch | ||
32,768.0 pipeline |
3 | $1.06 | 2.037 | Launch | ||
32,768.0 tensor |
4 | $1.26 | 3.654 | Launch | ||
32,768.0 tensor |
2 | $1.56 | 61.17 | 2.751 | Launch | |
32,768.0 tensor |
2 | $1.56 | 2.751 | Launch | ||
32,768.0 |
1 | $1.59 | 1.135 | Launch | ||
32,768.0 tensor |
4 | $1.82 | 1.358 | Launch | ||
32,768.0 tensor |
2 | $1.92 | 72.85 | 2.742 | Launch | |
32,768.0 |
1 | $2.37 | 59.41 | 6.644 | Launch | |
32,768.0 |
1 | $3.83 | 59.02 | 6.636 | Launch | |
32,768.0 |
1 | $4.11 | 8.235 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 15.560 | Launch | ||
32,768.0 |
1 | $4.74 | 13.607 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 29.487 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 tensor |
4 | $1.26 | 17.88 | 1.766 | Launch | |
32,768.0 pipeline |
3 | $1.34 | 2.812 | Launch | ||
32,768.0 tensor |
4 | $1.57 | 5.400 | Launch | ||
32,768.0 pipeline |
3 | $2.29 | 20.58 | 3.009 | Launch | |
32,768.0 |
1 | $2.37 | 39.51 | 4.709 | Launch | |
32,768.0 pipeline |
3 | $2.83 | 24.10 | 2.989 | Launch | |
32,768.0 tensor |
4 | $2.89 | 5.888 | Launch | ||
32,768.0 tensor |
2 | $2.93 | 2.691 | Launch | ||
32,768.0 tensor |
4 | $3.01 | 5.888 | Launch | ||
32,768.0 tensor |
4 | $3.60 | 5.869 | Launch | ||
32,768.0 |
1 | $3.83 | 41.38 | 4.603 | Launch | |
32,768.0 |
1 | $4.11 | 58.78 | 6.202 | Launch | |
32,768.0 tensor |
2 | $4.61 | 13.708 | Launch | ||
32,768.0 |
1 | $4.74 | 11.772 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 27.634 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 tensor |
4 | $1.76 | 1.815 | Launch | ||
32,768.0 |
1 | $2.51 | 22.26 | 1.209 | Launch | |
32,768.0 tensor |
4 | $2.97 | 37.03 | 2.303 | Launch | |
32,768.0 tensor |
4 | $3.67 | 2.284 | Launch | ||
32,768.0 |
1 | $3.96 | 1.201 | Launch | ||
32,768.0 |
1 | $4.12 | 2.800 | Launch | ||
32,768.0 pipeline |
3 | $4.35 | 2.182 | Launch | ||
32,768.0 |
1 | $4.74 | 8.172 | Launch | ||
32,768.0 tensor |
2 | $4.94 | 10.113 | Launch | ||
32,768.0 tensor |
4 | $5.76 | 5.886 | Launch | ||
32,768.0 tensor |
2 | $9.41 | 24.039 | Launch | ||
Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.