Qwen2.5-7B is a 7-billion-parameter model featuring 28 layers and a 28/4 attention head architecture, delivering substantially expanded capabilities compared to smaller versions. Its key advantage lies in supporting an extended 128K-token context window while maintaining 8K-token generation capacity, enabling it to process lengthy documents and retain complex multi-step tasks in memory.
The model demonstrates significantly enhanced capabilities in mathematical computations, programming, and logical reasoning due to the incorporation of specialized data during pretraining. It also shows substantial progress in understanding structured data formats including tables and JSON.
Qwen2.5-7B represents the optimal choice for most business applications requiring high-quality natural language processing without excessive infrastructure demands. The model excels at workflow automation, long-document analysis, and building intelligent decision-support systems.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.
A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.
We recommend creating private endpoints when you need to:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.38 | 25.68 | 2.754 | Launch | |
32,768.0 |
1 | $0.53 | 85.54 | 6.907 | Launch | |
32,768.0 |
1 | $0.83 | 179.67 | 7.464 | Launch | |
32,768.0 tensor |
2 | $0.97 | 156.92 | 3.229 | Launch | |
32,768.0 |
1 | $1.02 | 250.00 | 7.443 | Launch | |
32,768.0 tensor |
2 | $1.56 | 17.896 | Launch | ||
32,768.0 |
1 | $1.59 | 11.560 | Launch | ||
32,768.0 |
1 | $2.37 | 36.741 | Launch | ||
32,768.0 |
1 | $3.83 | 250.00 | 36.705 | Launch | |
32,768.0 |
1 | $4.11 | 308.00 | 44.017 | Launch | |
32,768.0 tensor |
2 | $4.61 | 76.450 | Launch | ||
32,768.0 |
1 | $4.74 | 68.573 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 140.114 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.38 | 18.21 | 1.961 | Launch | |
32,768.0 |
1 | $0.53 | 61.42 | 6.097 | Launch | |
32,768.0 |
1 | $0.83 | 90.01 | 6.654 | Launch | |
32,768.0 tensor |
2 | $0.97 | 120.21 | 3.933 | Launch | |
32,768.0 |
1 | $1.02 | 102.50 | 6.685 | Launch | |
32,768.0 tensor |
2 | $1.56 | 18.600 | Launch | ||
32,768.0 |
1 | $1.59 | 11.001 | Launch | ||
32,768.0 |
1 | $2.37 | 128.00 | 35.909 | Launch | |
32,768.0 |
1 | $3.83 | 134.38 | 35.729 | Launch | |
32,768.0 |
1 | $4.11 | 180.20 | 43.036 | Launch | |
32,768.0 tensor |
2 | $4.61 | 77.154 | Launch | ||
32,768.0 |
1 | $4.74 | 68.015 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 140.818 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.53 | 30.29 | 2.720 | Launch | |
32,768.0 tensor |
2 | $0.57 | 14.69 | 5.299 | Launch | |
32,768.0 |
1 | $0.83 | 49.21 | 3.277 | Launch | |
32,768.0 |
1 | $1.02 | 61.49 | 3.256 | Launch | |
32,768.0 pipeline |
3 | $1.43 | 43.84 | 4.593 | Launch | |
32,768.0 tensor |
2 | $1.56 | 14.720 | Launch | ||
32,768.0 |
1 | $1.59 | 7.373 | Launch | ||
32,768.0 tensor |
4 | $1.82 | 8.271 | Launch | ||
32,768.0 |
1 | $2.37 | 88.66 | 32.554 | Launch | |
32,768.0 |
1 | $3.83 | 96.79 | 32.409 | Launch | |
32,768.0 |
1 | $4.11 | 39.830 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 73.274 | Launch | ||
32,768.0 |
1 | $4.74 | 64.386 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 136.938 | Launch | ||
Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.