Qwen2-7B is a fully functional language model with 7 billion parameters, designed to deliver high performance across a wide range of tasks. The model features 28 layers, utilizes 28 attention heads in total with 4 key-value heads, striking an optimal balance between performance and memory efficiency. Its architecture incorporates all modern enhancements, including Grouped Query Attention (GQA), Dual Chunk Attention with YARN, and optimized Rotary Positional Embedding (RoPE) mechanisms.
Trained on the same high-quality 7-trillion-token dataset as larger models in the series, Qwen2-7B delivers strong performance across diverse knowledge domains and achieves competitive results on standard benchmarks. It supports an extended context window of 128K tokens and demonstrates exceptional multilingual capabilities.
A key advantage of Qwen2-7B is its ability to run efficiently on mid-range GPUs, making advanced AI capabilities accessible to a broader range of users and organizations. The model is well-suited for application development, large document analysis, research, and educational purposes. Additionally, it serves as an excellent base model for fine-tuning on domain-specific tasks, offering a strong trade-off between capability and resource requirements.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
Rent your own physically dedicated instance with hourly or long-term monthly billing.
We recommend deploying private instances in the following scenarios:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.33 | 3.906 | Launch | ||
32,768.0 |
1 | $0.38 | 1.803 | Launch | ||
32,768.0 |
1 | $0.38 | 3.927 | Launch | ||
32,768.0 |
1 | $0.53 | 8.080 | Launch | ||
32,768.0 |
1 | $0.57 | 1.304 | Launch | ||
32,768.0 |
1 | $0.83 | 8.637 | Launch | ||
32,768.0 |
1 | $1.02 | 8.616 | Launch | ||
32,768.0 tensor |
2 | $1.23 | 18.023 | Launch | ||
32,768.0 |
1 | $1.59 | 12.733 | Launch | ||
32,768.0 |
1 | $2.37 | 37.914 | Launch | ||
32,768.0 |
1 | $3.83 | 37.878 | Launch | ||
32,768.0 |
1 | $4.11 | 45.190 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 77.692 | Launch | ||
32,768.0 |
1 | $4.74 | 69.746 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 141.356 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.33 | 2.043 | Launch | ||
32,768.0 |
1 | $0.38 | 2.064 | Launch | ||
32,768.0 |
1 | $0.53 | 6.218 | Launch | ||
32,768.0 tensor |
2 | $0.69 | 3.606 | Launch | ||
32,768.0 |
1 | $0.83 | 6.775 | Launch | ||
32,768.0 tensor |
2 | $0.97 | 2.608 | Launch | ||
32,768.0 |
1 | $1.02 | 6.754 | Launch | ||
32,768.0 tensor |
2 | $1.23 | 16.160 | Launch | ||
32,768.0 |
1 | $1.59 | 10.870 | Launch | ||
32,768.0 |
1 | $2.37 | 36.052 | Launch | ||
32,768.0 |
1 | $3.83 | 36.015 | Launch | ||
32,768.0 |
1 | $4.11 | 43.328 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 75.829 | Launch | ||
32,768.0 |
1 | $4.74 | 67.884 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 139.493 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.53 | 1.837 | Launch | ||
32,768.0 tensor |
2 | $0.54 | 3.432 | Launch | ||
32,768.0 tensor |
2 | $0.57 | 3.474 | Launch | ||
32,768.0 |
1 | $0.83 | 2.394 | Launch | ||
32,768.0 pipeline |
3 | $0.84 | 2.313 | Launch | ||
32,768.0 |
1 | $1.02 | 2.373 | Launch | ||
32,768.0 tensor |
4 | $1.12 | 6.557 | Launch | ||
32,768.0 tensor |
2 | $1.23 | 11.780 | Launch | ||
32,768.0 |
1 | $1.59 | 6.490 | Launch | ||
32,768.0 tensor |
4 | $1.82 | 4.560 | Launch | ||
32,768.0 |
1 | $2.37 | 31.671 | Launch | ||
32,768.0 |
1 | $3.83 | 31.634 | Launch | ||
32,768.0 |
1 | $4.11 | 38.947 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 71.448 | Launch | ||
32,768.0 |
1 | $4.74 | 63.503 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 135.112 | Launch | ||
Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.