Qwen2.5-0.5B-Instruct

Qwen2.5-0.5B is the smallest model in the series, featuring 500 million parameters. It supports a 32K-token context window and can generate up to 8K tokens at once. The key advantages of this model are its exceptionally low power consumption and high processing speed while maintaining reasonable output quality. Optimized for deployment on resource-constrained devices—including mobile devices, IoT systems, and edge computing—it delivers solid performance in language understanding and basic reasoning tasks thanks to its high-quality pretraining on 18 trillion tokens.

Qwen2.5-0.5B is ideal for integration into applications requiring fast responses with limited computational power, such as website chatbots, mobile assistants, autocompletion systems, and basic text processing. It also serves as an excellent base model for fine-tuning specific tasks with minimal training and inference costs.


Announce Date: 16.09.2024
Parameters: 495M
Context: 33K
Layers: 24
Attention Type: Full Attention
Developer: Qwen
Transformers Version: 4.43.1
License: Apache 2.0

Public endpoint

Use our pre-built public endpoints for free to test inference and explore Qwen2.5-0.5B-Instruct capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link
There are no public endpoints for this model yet.

Private server

Rent your own physically dedicated instance with hourly or long-term monthly billing.

We recommend deploying private instances in the following scenarios:

  • maximize endpoint performance,
  • enable full context for long sequences,
  • ensure top-tier security for data processing in an isolated, dedicated environment,
  • use custom weights, such as fine-tuned models or LoRA adapters.

Recommended server configurations for hosting Qwen2.5-0.5B-Instruct

Prices:
Name GPU Price, hour TPS Max Concurrency
teslat4-1.16.16.160
32,768.0
1 $0.33 30.543 Launch
rtx2080ti-1.10.16.500
32,768.0
1 $0.38 18.543 Launch
teslaa2-1.16.32.160
32,768.0
1 $0.38 30.543 Launch
teslaa10-1.16.32.160
32,768.0
1 $0.53 49.743 Launch
rtx3080-1.16.32.160
32,768.0
1 $0.57 16.143 Launch
rtx3090-1.16.24.160
32,768.0
1 $0.83 49.743 Launch
rtx4090-1.16.32.160
32,768.0
1 $1.02 49.743 Launch
teslav100-1.12.64.160
32,768.0
1 $1.20 68.943 Launch
rtxa5000-2.16.64.160.nvlink
32,768.0
tensor
2 $1.23 100.677 Launch
rtx5090-1.16.64.160
32,768.0
1 $1.59 68.943 Launch
teslaa100-1.16.64.160
32,768.0
1 $2.37 184.143 Launch
h100-1.16.64.160
32,768.0
1 $3.83 184.143 Launch
h100nvl-1.16.96.160
32,768.0
1 $4.11 217.743 Launch
h200-1.16.128.160
32,768.0
1 $4.74 330.543 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslat4-1.16.16.160
32,768.0
1 $0.33 30.506 Launch
rtx2080ti-1.10.16.500
32,768.0
1 $0.38 18.506 Launch
teslaa2-1.16.32.160
32,768.0
1 $0.38 30.506 Launch
teslaa10-1.16.32.160
32,768.0
1 $0.53 49.706 Launch
rtx3080-1.16.32.160
32,768.0
1 $0.57 16.106 Launch
rtx3090-1.16.24.160
32,768.0
1 $0.83 49.706 Launch
rtx4090-1.16.32.160
32,768.0
1 $1.02 49.706 Launch
teslav100-1.12.64.160
32,768.0
1 $1.20 68.906 Launch
rtxa5000-2.16.64.160.nvlink
32,768.0
tensor
2 $1.23 100.640 Launch
rtx5090-1.16.64.160
32,768.0
1 $1.59 68.906 Launch
teslaa100-1.16.64.160
32,768.0
1 $2.37 184.106 Launch
h100-1.16.64.160
32,768.0
1 $3.83 184.106 Launch
h100nvl-1.16.96.160
32,768.0
1 $4.11 217.706 Launch
h200-1.16.128.160
32,768.0
1 $4.74 330.506 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslat4-1.16.16.160
32,768.0
1 $0.33 31.476 Launch
rtx2080ti-1.10.16.500
32,768.0
1 $0.38 19.476 Launch
teslaa2-1.16.32.160
32,768.0
1 $0.38 31.476 Launch
teslaa10-1.16.32.160
32,768.0
1 $0.53 50.676 Launch
rtx3080-1.16.32.160
32,768.0
1 $0.57 17.076 Launch
rtx3090-1.16.24.160
32,768.0
1 $0.83 50.676 Launch
rtx4090-1.16.32.160
32,768.0
1 $1.02 50.676 Launch
teslav100-1.12.64.160
32,768.0
1 $1.20 69.876 Launch
rtxa5000-2.16.64.160.nvlink
32,768.0
tensor
2 $1.23 101.609 Launch
rtx5090-1.16.64.160
32,768.0
1 $1.59 69.876 Launch
teslaa100-1.16.64.160
32,768.0
1 $2.37 185.076 Launch
h100-1.16.64.160
32,768.0
1 $3.83 185.076 Launch
h100nvl-1.16.96.160
32,768.0
1 $4.11 218.676 Launch
h200-1.16.128.160
32,768.0
1 $4.74 331.476 Launch

Related models

QwQ

Need help?

Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.