QwQ-32B is an innovative language model developed by Alibaba, featuring 32 billion parameters and a context window of 40K tokens. It is specifically designed for deep reasoning and excels at multi-step logical analysis, making it highly effective in solving complex tasks that require structured thinking.
QwQ-32B was trained using advanced reinforcement learning techniques, significantly enhancing its reasoning capabilities. This enables the model to deliver outstanding performance in areas such as mathematical computation, programming, and legal document analysis. In terms of performance, it rivals DeepSeek-R1, which has 671 billion parameters. Additionally, QwQ-32B possesses agent-like behavior capabilities, allowing it to adapt its reasoning based on feedback and utilize various tools for more accurate query analysis.
Thanks to its context window of 131,000 tokens, the model can handle large-scale analytical tasks and work with multi-step logical reasoning chains. This makes it indispensable for scientific research, educational applications, identifying issues in code, comparing arguments in legal documents, and other tasks that demand maximum attention to detail.
| Model Name | Context | Type | GPU | TPS | Tooling | Status | Link |
|---|---|---|---|---|---|---|---|
| Qwen/QwQ-32B | 40,960.0 | Public | 2×RTX4090 tensor |
46.40 | AVAILABLE | chat |
curl https://chat.immers.cloud/v1/endpoints/QwQ-32b/generate/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer USER_API_KEY" \
-d '{"model": "QwQ-32b", "messages": [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Say this is a test"}
], "temperature": 0, "max_tokens": 150}'
$response = Invoke-WebRequest https://chat.immers.cloud/v1/endpoints/QwQ-32b/generate/chat/completions `
-Method POST `
-Headers @{
"Authorization" = "Bearer USER_API_KEY"
"Content-Type" = "application/json"
} `
-Body (@{
model = "QwQ-32b"
messages = @(
@{ role = "system"; content = "You are a helpful assistant." },
@{ role = "user"; content = "Say this is a test" }
)
} | ConvertTo-Json)
($response.Content | ConvertFrom-Json).choices[0].message.content
#!pip install OpenAI --upgrade
from openai import OpenAI
client = OpenAI(
api_key="USER_API_KEY",
base_url="https://chat.immers.cloud/v1/endpoints/QwQ-32b/generate/",
)
chat_response = client.chat.completions.create(
model="QwQ-32b",
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Say this is a test"},
]
)
print(chat_response.choices[0].message.content)
Rent your own physically dedicated instance with hourly or long-term monthly billing.
We recommend deploying private instances in the following scenarios:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
40,960.0 pipeline |
3 | $0.88 | 1.637 | Launch | ||
40,960.0 tensor |
2 | $0.93 | 1.887 | Launch | ||
40,960.0 tensor |
4 | $0.96 | 2.827 | Launch | ||
40,960.0 pipeline |
3 | $1.06 | 1.637 | Launch | ||
40,960.0 tensor |
4 | $1.12 | 1.027 | Launch | ||
40,960.0 tensor |
2 | $1.23 | 1.887 | Launch | ||
40,960.0 tensor |
4 | $1.26 | 2.827 | Launch | ||
40,960.0 tensor |
2 | $1.56 | 1.887 | Launch | ||
40,960.0 tensor |
2 | $1.92 | 1.887 | Launch | ||
40,960.0 |
1 | $2.37 | 5.017 | Launch | ||
40,960.0 tensor |
2 | $2.93 | 3.327 | Launch | ||
40,960.0 |
1 | $3.83 | 5.017 | Launch | ||
40,960.0 |
1 | $4.11 | 6.277 | Launch | ||
40,960.0 |
1 | $4.74 | 10.507 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
40,960.0 tensor |
4 | $0.96 | 1.733 | Launch | ||
40,960.0 tensor |
4 | $1.26 | 1.733 | Launch | ||
40,960.0 pipeline |
3 | $1.34 | 2.703 | Launch | ||
40,960.0 tensor |
4 | $1.57 | 4.613 | Launch | ||
40,960.0 pipeline |
3 | $2.29 | 2.703 | Launch | ||
40,960.0 tensor |
4 | $2.34 | 4.613 | Launch | ||
40,960.0 |
1 | $2.37 | 3.923 | Launch | ||
40,960.0 pipeline |
3 | $2.83 | 2.703 | Launch | ||
40,960.0 tensor |
4 | $2.89 | 4.613 | Launch | ||
40,960.0 tensor |
2 | $2.93 | 2.233 | Launch | ||
40,960.0 tensor |
4 | $3.60 | 4.613 | Launch | ||
40,960.0 |
1 | $3.83 | 3.923 | Launch | ||
40,960.0 |
1 | $4.11 | 5.183 | Launch | ||
40,960.0 |
1 | $4.74 | 9.413 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
40,960.0 tensor |
4 | $1.76 | 1.083 | Launch | ||
40,960.0 tensor |
4 | $2.97 | 1.083 | Launch | ||
40,960.0 tensor |
4 | $3.68 | 1.083 | Launch | ||
40,960.0 |
1 | $4.12 | 1.653 | Launch | ||
40,960.0 pipeline |
3 | $4.35 | 1.333 | Launch | ||
40,960.0 |
1 | $4.74 | 5.883 | Launch | ||
40,960.0 tensor |
2 | $4.93 | 7.343 | Launch | ||
40,960.0 tensor |
4 | $5.76 | 3.963 | Launch | ||
40,960.0 tensor |
2 | $7.85 | 7.343 | Launch | ||
Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.