Qwen2-1.5B is a lightweight model with 1.5 billion parameters, offering an optimal balance between performance and resource efficiency. The model includes 28 layers and employs Grouped Query Attention (GQA) with 12 query heads and 2 shared key-value heads, enabling efficient management of the KV-cache memory.
Trained on 7 trillion tokens of high-quality multilingual data, the model demonstrates significantly enhanced capabilities compared to previous versions, particularly in programming and mathematics. It supports a wide range of languages and delivers competitive results on standard benchmarks, while maintaining relatively low computational resource requirements.
Qwen2-1.5B stands out for its versatility and ability to perform efficiently on both consumer-grade hardware and small servers. The model supports a context window of 32K tokens, allowing it to process long documents and support complex conversations. It is ideally suited for information extraction, document analysis, entry-level programming tasks, educational applications, and enterprise chatbots. Qwen2-1.5B is an excellent choice for users seeking a reliable language model for simple tasks without the need for expensive GPU infrastructure.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
Rent your own physically dedicated instance with hourly or long-term monthly billing.
We recommend deploying private instances in the following scenarios:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.33 | 10.739 | Launch | ||
32,768.0 |
1 | $0.38 | 6.533 | Launch | ||
32,768.0 |
1 | $0.38 | 10.781 | Launch | ||
32,768.0 |
1 | $0.53 | 19.087 | Launch | ||
32,768.0 |
1 | $0.57 | 5.535 | Launch | ||
32,768.0 |
1 | $0.83 | 20.202 | Launch | ||
32,768.0 |
1 | $1.02 | 20.160 | Launch | ||
32,768.0 tensor |
2 | $1.23 | 38.973 | Launch | ||
32,768.0 |
1 | $1.59 | 28.393 | Launch | ||
32,768.0 |
1 | $2.37 | 78.756 | Launch | ||
32,768.0 |
1 | $3.83 | 78.682 | Launch | ||
32,768.0 |
1 | $4.11 | 93.308 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 158.310 | Launch | ||
32,768.0 |
1 | $4.74 | 142.420 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 285.638 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.33 | 9.941 | Launch | ||
32,768.0 |
1 | $0.38 | 5.735 | Launch | ||
32,768.0 |
1 | $0.38 | 9.983 | Launch | ||
32,768.0 |
1 | $0.53 | 18.289 | Launch | ||
32,768.0 |
1 | $0.57 | 4.736 | Launch | ||
32,768.0 |
1 | $0.83 | 19.404 | Launch | ||
32,768.0 |
1 | $1.02 | 19.362 | Launch | ||
32,768.0 tensor |
2 | $1.23 | 38.175 | Launch | ||
32,768.0 |
1 | $1.59 | 27.594 | Launch | ||
32,768.0 |
1 | $2.37 | 77.958 | Launch | ||
32,768.0 |
1 | $3.83 | 77.884 | Launch | ||
32,768.0 |
1 | $4.11 | 92.510 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 157.512 | Launch | ||
32,768.0 |
1 | $4.74 | 141.622 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 284.840 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
32,768.0 |
1 | $0.33 | 8.251 | Launch | ||
32,768.0 |
1 | $0.38 | 4.045 | Launch | ||
32,768.0 |
1 | $0.38 | 8.293 | Launch | ||
32,768.0 |
1 | $0.53 | 16.600 | Launch | ||
32,768.0 |
1 | $0.57 | 3.047 | Launch | ||
32,768.0 |
1 | $0.83 | 17.714 | Launch | ||
32,768.0 |
1 | $1.02 | 17.672 | Launch | ||
32,768.0 tensor |
2 | $1.23 | 36.485 | Launch | ||
32,768.0 |
1 | $1.59 | 25.905 | Launch | ||
32,768.0 |
1 | $2.37 | 76.268 | Launch | ||
32,768.0 |
1 | $3.83 | 76.194 | Launch | ||
32,768.0 |
1 | $4.11 | 90.820 | Launch | ||
32,768.0 tensor |
2 | $4.61 | 155.822 | Launch | ||
32,768.0 |
1 | $4.74 | 139.932 | Launch | ||
32,768.0 tensor |
2 | $9.40 | 283.150 | Launch | ||
Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.