Qwen3-4B-Thinking-2507

reasoning

Qwen3-4B-Thinking-2507 is an enhanced version of Qwen3-4B. Built on the same base architecture with 4 billion parameters and 36 layers, featuring Group Query Attention (GQA) with 32 heads for queries and 8 for keys/values, it is fundamentally differentiated by specialized training for deep question analysis and multi-step problem solving. The model features extended reasoning length, enabling thorough examination of every aspect of a task before formulating the final answer, along with native support for a 262K-token context. It automatically generates a visible reasoning process within <think></think> blocks, allowing users to track the solution logic while significantly improving the model's inference quality on complex tasks.

The model delivers exceptional performance in tasks requiring deep analysis. On the AIME25 math olympiad benchmark, it achieves a score of 81.3—15.7 points higher than the base version. On HMMT25 (Harvard-MIT math competitions), it scores 55.5, outperforming the base model by 13.4 points. In academic tests at the PhD level, the model achieves results remarkable for a 4-billion-parameter model: GPQA (65.8) and SuperGPQA (47.8). In agent-based tasks, it surpasses many specialized models: BFCL-v3 (71.2), TAU1-Retail (66.1), TAU2-Retail (53.5), confirming its strength in complex, multi-step planning.

Qwen3-4B-Thinking-2507 is ideal for everyday tasks—simple yet requiring thoughtful processing—such as literature review preparation, drafting academic paper templates, and analyzing trends in statistical data. It is also highly effective in solving more complex technical challenges, including software debugging and architectural design, as well as in educational applications such as creating teaching materials and automated grading systems.


Announce Date: 07.08.2025
Parameters: 5B
Context: 263K
Layers: 36
Attention Type: Full or Sliding Window Attention
Developer: Qwen
Transformers Version: 4.51.0
License: Apache 2.0

Public endpoint

Use our pre-built public endpoints for free to test inference and explore Qwen3-4B-Thinking-2507 capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link
There are no public endpoints for this model yet.

Private server

Rent your own physically dedicated instance with hourly or long-term monthly billing.

We recommend deploying private instances in the following scenarios:

  • maximize endpoint performance,
  • enable full context for long sequences,
  • ensure top-tier security for data processing in an isolated, dedicated environment,
  • use custom weights, such as fine-tuned models or LoRA adapters.

Recommended server configurations for hosting Qwen3-4B-Thinking-2507

Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-1.16.32.160
80,000.0
1 $0.53 1.364 Launch
teslaa2-2.16.32.160
80,000.0
tensor
2 $0.57 1.721 Launch
rtx3090-1.16.24.160
80,000.0
1 $0.83 1.452 Launch
rtx4090-1.16.32.160
80,000.0
1 $1.02 1.449 Launch
teslaa2-4.32.128.160
262,144.0
tensor
4 $1.26 1.147 Launch
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 73.39 1.468 Launch
rtx3080-3.16.64.160
80,000.0
pipeline
3 $1.43 1.486 Launch
rtx3090-2.16.64.160.nvlink
80,000.0
tensor
2 $1.56 3.207 Launch
teslaa10-4.12.48.160
262,144.0
tensor
4 $1.57 1.954 Launch
rtx5090-1.16.64.160
80,000.0
1 $1.59 2.105 Launch
rtx3080-4.16.64.160
80,000.0
tensor
4 $1.82 2.087 Launch
rtx3090-3.16.96.160
262,144.0
pipeline
3 $2.29 100.87 1.550 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 207.52 1.866 Launch
rtx4090-3.16.96.160
262,144.0
pipeline
3 $2.83 126.38 1.547 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 2.063 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.381 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 2.063 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 2.059 Launch
h100-1.16.64.160
262,144.0
1 $3.83 193.28 1.746 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 186.94 2.220 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.829 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.414 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 6.924 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-1.16.32.160
80,000.0
1 $0.53 1.274 Launch
teslaa2-2.16.32.160
80,000.0
tensor
2 $0.57 1.686 Launch
rtx3090-1.16.24.160
80,000.0
1 $0.83 1.363 Launch
rtx4090-1.16.32.160
80,000.0
1 $1.02 1.359 Launch
teslaa2-4.32.128.160
262,144.0
tensor
4 $1.26 1.170 Launch
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 75.24 1.448 Launch
rtx3080-3.16.64.160
80,000.0
pipeline
3 $1.43 1.507 Launch
rtx3090-2.16.64.160.nvlink
80,000.0
tensor
2 $1.56 3.145 Launch
teslaa10-4.12.48.160
262,144.0
tensor
4 $1.57 1.978 Launch
rtx5090-1.16.64.160
80,000.0
1 $1.59 2.015 Launch
rtx3080-4.16.64.160
80,000.0
tensor
4 $1.82 2.163 Launch
rtx3090-3.16.96.160
262,144.0
pipeline
3 $2.29 105.53 1.530 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 149.15 1.844 Launch
rtx4090-3.16.96.160
262,144.0
pipeline
3 $2.83 67.99 1.526 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 2.086 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.371 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 2.086 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 2.082 Launch
h100-1.16.64.160
262,144.0
1 $3.83 152.15 1.724 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 2.193 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.819 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.386 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 6.914 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-1.16.32.160
80,000.0
1 $0.53 1.050 Launch
teslaa2-2.16.32.160
80,000.0
tensor
2 $0.57 1.488 Launch
rtx3090-1.16.24.160
80,000.0
1 $0.83 1.139 Launch
rtx4090-1.16.32.160
80,000.0
1 $1.02 1.136 Launch
teslaa2-4.32.128.160
262,144.0
tensor
4 $1.26 48.37 1.125 Launch
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 45.67 1.355 Launch
rtx3080-3.16.64.160
80,000.0
pipeline
3 $1.43 1.333 Launch
rtx3090-2.16.64.160.nvlink
80,000.0
tensor
2 $1.56 2.988 Launch
teslaa10-4.12.48.160
262,144.0
tensor
4 $1.57 1.932 Launch
rtx5090-1.16.64.160
80,000.0
1 $1.59 1.791 Launch
rtx3080-4.16.64.160
80,000.0
tensor
4 $1.82 2.014 Launch
rtx3090-3.16.96.160
262,144.0
pipeline
3 $2.29 53.62 1.666 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 94.97 1.771 Launch
rtx4090-3.16.96.160
262,144.0
pipeline
3 $2.83 63.41 1.627 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 2.041 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.310 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 2.041 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 2.036 Launch
h100-1.16.64.160
262,144.0
1 $3.83 124.57 1.729 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 178.90 1.986 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.758 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.318 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 6.853 Launch

Related models

Need help?

Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.

We use cookies and web analytics services to ensure the proper functioning of the website, analyze web-site traffic, and improve the quality of our services.
By continuing to use the website, you consent to the Privacy Policy and consent to the processing of cookie files and technical data.