Phi-4-multimodal-instruct is an open-source multimodal model from Microsoft that processes text, images, and audio in a unified architectural solution. It builds upon the Phi-3.5 and Phi-4.0 technologies, featuring an extended context window of 128K tokens and support for 23 languages in text (including Russian), 8 languages in audio, and English for visual tasks. The model is optimized for environments with limited computational resources and low-latency scenarios, demonstrating strong performance in mathematics, logic, speech recognition, translation, and image analysis.
A single neural network handles text, images (OCR, tables, diagrams), and audio (recognition, translation, summarization). For example, in DocVQA benchmarks, the model achieves 93.2% accuracy, outperforming Gemini-2.0-Flash (92.1%).
The model is ideal for multisensory applications—joint processing of audio and images (e.g., video analysis with subtitles). At the same time, thanks to optimization via Microsoft Olive and ONNX GenAI Runtime, it can be deployed on edge devices, including smartphones and IoT systems, even with limited computational resources.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.
A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.
We recommend creating private endpoints when you need to:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
131,072.0 tensor |
2 | $0.93 | 1.414 | Launch | ||
131,072.0 pipeline |
3 | $1.06 | 1.075 | Launch | ||
131,072.0 tensor |
4 | $1.26 | 1.757 | Launch | ||
131,072.0 tensor |
2 | $1.56 | 1.536 | Launch | ||
131,072.0 tensor |
2 | $1.56 | 1.536 | Launch | ||
131,072.0 tensor |
2 | $1.92 | 1.532 | Launch | ||
131,072.0 |
1 | $2.37 | 3.597 | Launch | ||
131,072.0 tensor |
2 | $2.93 | 2.432 | Launch | ||
131,072.0 |
1 | $3.83 | 3.593 | Launch | ||
131,072.0 |
1 | $4.11 | 4.393 | Launch | ||
131,072.0 tensor |
2 | $4.61 | 7.941 | Launch | ||
131,072.0 |
1 | $4.74 | 7.079 | Launch | ||
131,072.0 tensor |
2 | $9.40 | 14.904 | Launch | ||
Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.