Phi-3.5-mini is the latest model from Microsoft’s Phi series of small language models, combining compactness with high performance. Built on an architecture with 3.8 billion parameters, it can run locally even on modern smartphones, making it one of the most accessible and efficient language models on the market. Thanks to its use of carefully curated and synthetic training data, Phi-3.5-mini delivers results comparable to much larger models such as GPT-3.5 and Mixtral 8x7B, while requiring significantly fewer computational resources.
The uniqueness of Phi-3.5-mini lies in its training approach: instead of simply increasing the model size, developers focused on the quality and relevance of the data. By using carefully filtered web sources and synthetic examples, the model achieves a “data optimal regime”—maximizing the effectiveness of each parameter. This enables Phi-3.5-mini to deliver outstanding performance in reasoning, mathematics, programming, and dialogue tasks, all while remaining compact and fast.
Phi-3.5-mini is particularly well-suited for edge devices, mobile applications, chatbots, educational platforms, and any scenarios where privacy and offline operation are important. The model is ideal for building multilingual assistants, text generation and analysis, solving mathematical and logical problems, and integration into products with limited computational resources.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
Rent your own physically dedicated instance with hourly or long-term monthly billing.
We recommend deploying private instances in the following scenarios:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
44,000.0 |
1 | $0.53 | 1.073 | Launch | ||
44,000.0 tensor |
2 | $0.57 | 1.391 | Launch | ||
44,000.0 |
1 | $0.83 | 1.134 | Launch | ||
44,000.0 |
1 | $1.02 | 1.131 | Launch | ||
44,000.0 tensor |
2 | $1.56 | 2.415 | Launch | ||
44,000.0 |
1 | $1.59 | 1.579 | Launch | ||
131,072.0 tensor |
4 | $1.62 | 1.589 | Launch | ||
44,000.0 tensor |
4 | $1.82 | 1.790 | Launch | ||
131,072.0 |
1 | $2.37 | 149.60 | 1.448 | Launch | |
131,072.0 tensor |
4 | $2.89 | 1.671 | Launch | ||
131,072.0 tensor |
2 | $2.93 | 1.109 | Launch | ||
131,072.0 tensor |
4 | $3.01 | 1.671 | Launch | ||
131,072.0 tensor |
4 | $3.60 | 1.667 | Launch | ||
131,072.0 |
1 | $3.83 | 1.447 | Launch | ||
131,072.0 |
1 | $4.11 | 1.713 | Launch | ||
131,072.0 tensor |
2 | $4.61 | 2.945 | Launch | ||
131,072.0 |
1 | $4.74 | 2.609 | Launch | ||
131,072.0 tensor |
2 | $9.40 | 5.266 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
44,000.0 tensor |
2 | $0.57 | 1.029 | Launch | ||
44,000.0 tensor |
2 | $0.93 | 1.931 | Launch | ||
44,000.0 tensor |
2 | $1.56 | 2.052 | Launch | ||
44,000.0 tensor |
2 | $1.56 | 2.052 | Launch | ||
44,000.0 |
1 | $1.59 | 1.249 | Launch | ||
131,072.0 tensor |
4 | $1.62 | 1.445 | Launch | ||
44,000.0 tensor |
4 | $1.82 | 1.362 | Launch | ||
44,000.0 tensor |
2 | $1.92 | 2.048 | Launch | ||
131,072.0 |
1 | $2.37 | 148.86 | 1.338 | Launch | |
131,072.0 tensor |
4 | $2.89 | 1.527 | Launch | ||
131,072.0 tensor |
4 | $3.01 | 1.527 | Launch | ||
131,072.0 tensor |
4 | $3.60 | 1.524 | Launch | ||
131,072.0 |
1 | $3.83 | 176.94 | 1.336 | Launch | |
131,072.0 |
1 | $4.11 | 1.603 | Launch | ||
131,072.0 tensor |
2 | $4.61 | 2.824 | Launch | ||
131,072.0 |
1 | $4.74 | 2.498 | Launch | ||
131,072.0 tensor |
4 | $5.74 | 2.124 | Launch | ||
131,072.0 tensor |
2 | $9.40 | 5.145 | Launch | ||
Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.