Qwen3-VL-8B-Thinking

reasoning
multimodal

Qwen3-VL-8B-Thinking is an 8-billion-parameter model designed for the in-depth analysis of complex multimodal tasks. Its key feature is the ability for extended, step-by-step reasoning, which is displayed between special tags. This not only leads to a more accurate and well-founded answer but also makes the model's train of thought transparent to the user. Such thorough analysis logically requires more time compared to the faster, but more direct, Instruct version. Architecturally, the model inherits all the innovations of Qwen3-VL: Interleaved-MRoPE for enhanced video understanding, DeepStack for multi-level fusion of visual features, and Text-Timestamp Alignment for precise temporal localization. The context window is 256K tokens with the possibility of expansion up to 1M, and the recommended output sequence length is increased to 40,960 tokens (compared to 16,384 in the Instruct version) to provide sufficient space for extended reasoning chains.

The model achieves strong results on mathematical reasoning benchmarks: 81.4% on MathVista (mini version) and 62.7% on MATH-Vision, outperforming many significantly larger models. At the same time, the model is unmatched on all major 2D/3D Grounding and General VQA benchmarks.

Qwen3-VL-8B-Thinking is particularly effective in scenarios involving the intelligent processing of complex documents, where not only text recognition is required but also an understanding of logical connections, extraction of insights, and drawing conclusions. Advanced OCR capabilities in 32 languages, combined with reasoning mechanisms, make the model an ideal tool for analyzing multilingual documentation, scientific articles, and technical literature. Overall, the model is applicable to any situation that requires not just solving a problem but also a detailed explanation of the solution process.


Announce Date: 15.10.2025
Parameters: 9B
Context: 263K
Layers: 36
Attention Type: Full Attention
Developer: Qwen
Transformers Version: 4.57.0.dev0

Public endpoint

Use our pre-built public endpoints for free to test inference and explore Qwen3-VL-8B-Thinking capabilities. You can obtain an API access token on the token management page after registration and verification.
Model Name Context Type GPU Status Link

API access to Qwen3-VL-8B-Thinking endpoints

There are no public endpoints for this model yet.

Private endpoint

An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.

A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.

We recommend creating private endpoints when you need to:

  • achieve maximum endpoint performance,
  • access the full context window for processing large requests and conversations,
  • ensure maximum security by processing data in a dedicated, isolated environment.

Recommended server configurations for creating a private inference endpoint Qwen3-VL-8B-Thinking

Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 1.223 Launch
teslaa10-4.12.48.160
262,144.0
tensor
4 $1.57 1.703 Launch
teslaa2-6.32.128.160
262,144.0
pipeline
6 $1.65 1.452 Launch
rtx3090-3.16.96.160
262,144.0
pipeline
3 $2.29 1.305 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 152.97 1.714 Launch
rtx4090-3.16.96.160
262,144.0
pipeline
3 $2.83 1.302 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 1.812 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.196 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 1.812 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 1.808 Launch
h100-1.16.64.160
262,144.0
1 $3.83 137.69 1.712 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 218.62 2.067 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.644 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.261 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 6.739 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 1.180 Launch
teslaa10-4.12.48.160
262,144.0
tensor
4 $1.57 1.669 Launch
teslaa2-6.32.128.160
262,144.0
pipeline
6 $1.65 1.435 Launch
rtx3090-3.16.96.160
262,144.0
pipeline
3 $2.29 1.262 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 121.13 1.653 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 1.777 Launch
rtx5090-2.16.64.160
262,144.0
tensor
2 $2.93 1.144 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 1.777 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 1.773 Launch
h100-1.16.64.160
262,144.0
1 $3.83 110.42 1.507 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 2.007 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.592 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.201 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 6.687 Launch
Prices:
Name GPU Price, hour TPS Max Concurrency
teslaa10-3.16.96.160
262,144.0
pipeline
3 $1.34 1.038 Launch
teslaa10-4.16.64.160
262,144.0
tensor
4 $1.62 72.92 1.547 Launch
teslaa2-6.32.128.160
262,144.0
pipeline
6 $1.65 1.353 Launch
teslaa100-1.16.64.160
262,144.0
1 $2.37 71.89 1.380 Launch
rtx3090-4.16.64.160
262,144.0
tensor
4 $2.89 86.65 1.187 Launch
rtx3090-4.16.128.160.nvlink
262,144.0
tensor
4 $3.01 1.187 Launch
rtx4090-4.16.64.160
262,144.0
tensor
4 $3.60 97.43 1.183 Launch
h100nvl-1.16.96.160
262,144.0
1 $4.11 121.87 1.586 Launch
rtx5090-3.16.96.160
262,144.0
pipeline
3 $4.34 1.717 Launch
teslaa100-2.24.96.160.nvlink
262,144.0
tensor
2 $4.61 3.430 Launch
h200-1.16.128.160
262,144.0
1 $4.74 3.019 Launch
rtx5090-4.16.128.160
262,144.0
tensor
4 $5.74 2.451 Launch
h100-2.24.256.160
262,144.0
tensor
2 $7.84 3.426 Launch
h200-2.24.256.160.nvlink
262,144.0
tensor
2 $9.40 6.525 Launch

Related models

Need help?

Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.

We use cookies and web analytics services to ensure the proper functioning of the website, analyze web-site traffic, and improve the quality of our services.
By continuing to use the website, you consent to the Privacy Policy and consent to the processing of cookie files and technical data.