DeepSeek-V3

DeepSeek-V3 — introduced on December 26, 2014 by the Chinese company DeepSeek AI, this model brought the company worldwide recognition. It employs a Mixture-of-Experts (MoE) architecture with a total of 671 billion parameters, of which only 37 billion are activated for processing each token. This design ensures high performance and computational efficiency.

The model supports a context window of up to 164 thousand tokens and demonstrates excellent results in text generation, including in Russian. It handles tasks that require analyzing long documents, creating complex content, and working with large volumes of data — for example, automation of documentation, reports, educational materials, or legal consultations.

In benchmarks, DeepSeek-V3 has shown outstanding results, particularly in mathematics and programming, surpassing many open-source models and competing with GPT-4o and Claude 3.5 Sonnet. The model also successfully passed the Needle In A Haystack (NIAH) test at a context length of up to 128K. Thanks to its scalability, quality, and open license, DeepSeek-V3 is a promising choice for large-scale research and commercial projects.

Announce Date: 26.12.2024
Parameters: 671B
Experts: 256
Activated at inference: 37B
Context: 164K
Layers: 61
Attention Type: Multi-head Latent Attention
Developer: DeepSeek
Transformers Version: 4.33.1
License: MIT

Use our pre-built public endpoints for free to test inference and explore DeepSeek-V3 capabilities. You can obtain an API access token on the token management page after registration and verification.

An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.

A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.

We recommend creating private endpoints when you need to:

• achieve maximum endpoint performance,
• access the full context window for processing large requests and conversations,
• ensure maximum security by processing data in a dedicated, isolated environment.

Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.