Llama-3.3-70B is the latest version of the popular Llama 3 series, optimized for dialogue and assistant-like scenarios. The model has been trained on over 15 trillion tokens from open-source data, with an expanded context window of up to 128 thousand tokens, enabling it to efficiently handle long conversations and large texts. Llama-3.3-70B utilizes supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to better adapt to user queries, providing not only accuracy but also safer responses.
The model is distributed under the special commercial Llama 3.3 Community License, which allows its use in both research and commercial applications, provided the acceptable usage policy is followed. However, Llama-3.3-70B is not intended for use in mission-critical domains (e.g., healthcare, finance, infrastructure control, etc.).
Llama-3.3-70B is a powerful language model optimized for conversational and assistant tasks. It's ideal for building chatbots and automating customer support. In essence, it serves as a versatile tool for natural language generation, summarization, translation, code writing, and a wide range of other applications requiring high-quality language processing.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
An endpoint is a server with pre-installed software that automatically downloads neural network weights and launches an OpenAI-compatible API to handle incoming requests.
A private endpoint is created within the user's project, belongs exclusively to the user, and is billed per server configuration in accordance with the infrastructure pricing.
We recommend creating private endpoints when you need to:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
131,072.0 |
1 | $4.11 | 1.135 | Launch | ||
131,072.0 tensor |
2 | $4.61 | 2.554 | Launch | ||
131,072.0 |
1 | $4.74 | 2.210 | Launch | ||
131,072.0 tensor |
2 | $4.93 | 2.554 | Launch | ||
131,072.0 tensor |
4 | $5.74 | 1.622 | Launch | ||
131,072.0 pipeline |
6 | $5.83 | 1.683 | Launch | ||
131,072.0 tensor |
8 | $6.04 | 2.731 | Launch | ||
131,072.0 tensor |
8 | $7.51 | 2.724 | Launch | ||
131,072.0 tensor |
2 | $7.84 | 2.551 | Launch | ||
131,072.0 tensor |
2 | $9.40 | 5.340 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
131,072.0 |
1 | $4.74 | 1.461 | Launch | ||
131,072.0 tensor |
2 | $4.93 | 34.80 | 1.852 | Launch | |
131,072.0 tensor |
2 | $4.94 | 1.852 | Launch | ||
131,072.0 pipeline |
6 | $5.84 | 1.048 | Launch | ||
131,072.0 tensor |
8 | $6.04 | 2.152 | Launch | ||
131,072.0 tensor |
8 | $7.52 | 2.144 | Launch | ||
131,072.0 tensor |
2 | $7.85 | 39.84 | 1.841 | Launch | |
131,072.0 tensor |
2 | $8.17 | 59.71 | 2.481 | Launch | |
131,072.0 pipeline |
6 | $8.86 | 2.077 | Launch | ||
131,072.0 tensor |
2 | $9.41 | 4.615 | Launch | ||
131,072.0 tensor |
8 | $11.55 | 3.585 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
131,072.0 pipeline |
3 | $7.36 | 1.887 | Launch | ||
131,072.0 tensor |
4 | $9.14 | 3.698 | Launch | ||
131,072.0 tensor |
2 | $9.41 | 2.991 | Launch | ||
131,072.0 tensor |
2 | $9.41 | 2.991 | Launch | ||
131,072.0 tensor |
4 | $9.50 | 3.698 | Launch | ||
131,072.0 tensor |
8 | $11.55 | 1.871 | Launch | ||
131,072.0 pipeline |
3 | $11.73 | 12.26 | 1.882 | Launch | |
131,072.0 pipeline |
3 | $12.38 | 2.830 | Launch | ||
131,072.0 tensor |
4 | $14.96 | 3.692 | Launch | ||
131,072.0 tensor |
4 | $16.22 | 4.972 | Launch | ||
Contact our dedicated neural networks support team at support@immers.cloud or send your request to the sales department at sale@immers.cloud.