Llama-3.3-70B is the latest version of the popular Llama 3 series, optimized for dialogue and assistant-like scenarios. The model has been trained on over 15 trillion tokens from open-source data, with an expanded context window of up to 128 thousand tokens, enabling it to efficiently handle long conversations and large texts. Llama-3.3-70B utilizes supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to better adapt to user queries, providing not only accuracy but also safer responses.
The model is distributed under the special commercial Llama 3.3 Community License, which allows its use in both research and commercial applications, provided the acceptable usage policy is followed. However, Llama-3.3-70B is not intended for use in mission-critical domains (e.g., healthcare, finance, infrastructure control, etc.).
Llama-3.3-70B is a powerful language model optimized for conversational and assistant tasks. It's ideal for building chatbots and automating customer support. In essence, it serves as a versatile tool for natural language generation, summarization, translation, code writing, and a wide range of other applications requiring high-quality language processing.
| Model Name | Context | Type | GPU | Status | Link |
|---|
There are no public endpoints for this model yet.
Rent your own physically dedicated instance with hourly or long-term monthly billing.
We recommend deploying private instances in the following scenarios:
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
131,072.0 tensor |
8 | 2.755 | Launch | |||
131,072.0 pipeline |
6 | $3.50 | 1.644 | Launch | ||
131,072.0 |
1 | $4.11 | 1.138 | Launch | ||
131,072.0 tensor |
2 | $4.61 | 2.560 | Launch | ||
131,072.0 tensor |
8 | $4.61 | 2.560 | Launch | ||
131,072.0 |
1 | $4.74 | 2.213 | Launch | ||
131,072.0 tensor |
2 | $4.93 | 2.560 | Launch | ||
131,072.0 tensor |
4 | $5.74 | 1.634 | Launch | ||
131,072.0 pipeline |
6 | $5.83 | 1.785 | Launch | ||
131,072.0 tensor |
8 | $7.51 | 2.748 | Launch | ||
131,072.0 tensor |
2 | $7.84 | 2.557 | Launch | ||
131,072.0 tensor |
2 | $9.40 | 5.346 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
131,072.0 tensor |
8 | 1.983 | Launch | |||
131,072.0 |
1 | $4.74 | 1.441 | Launch | ||
131,072.0 tensor |
2 | $4.93 | 1.789 | Launch | ||
131,072.0 tensor |
2 | $4.94 | 1.789 | Launch | ||
131,072.0 tensor |
8 | $7.52 | 1.976 | Launch | ||
131,072.0 tensor |
2 | $7.85 | 1.785 | Launch | ||
131,072.0 tensor |
2 | $8.17 | 2.425 | Launch | ||
131,072.0 pipeline |
6 | $8.86 | 2.055 | Launch | ||
131,072.0 tensor |
2 | $9.41 | 4.574 | Launch | ||
131,072.0 tensor |
8 | $11.55 | 3.416 | Launch | ||
| Name | GPU | TPS | Max Concurrency | |||
|---|---|---|---|---|---|---|
131,072.0 pipeline |
3 | $7.36 | 1.894 | Launch | ||
131,072.0 tensor |
4 | $9.14 | 3.676 | Launch | ||
131,072.0 tensor |
2 | $9.41 | 2.980 | Launch | ||
131,072.0 tensor |
2 | $9.41 | 2.980 | Launch | ||
131,072.0 tensor |
4 | $9.50 | 3.676 | Launch | ||
131,072.0 tensor |
8 | $11.55 | 1.823 | Launch | ||
131,072.0 pipeline |
3 | $11.73 | 1.889 | Launch | ||
131,072.0 pipeline |
3 | $12.38 | 2.849 | Launch | ||
131,072.0 tensor |
4 | $14.96 | 3.669 | Launch | ||
131,072.0 tensor |
4 | $16.23 | 4.949 | Launch | ||
Contact our dedicated neural networks support team at nn@immers.cloud or send your request to the sales department at sale@immers.cloud.