Graphics servers with NVIDIA H100 NVL 94GB
All graphics servers with NVIDIA H100 NVL 94GB are based on two Intel Xeon Gold 3rd generation 6336Y CPUs with a base clock frequency of 2.4 GHz and a maximum clock frequency with Turbo Boost technology of 3.6 GHz.
Each processor contains two Intel® AVX-512 units and supports Intel® AVX-512 Deep Learning Boost functions. This set of instructions speeds up multiplication and addition operations with reduced accuracy, which are used in many internal cycles of the deep learning algorithm.
Each server has up to 4096 GB of DDR4 ECC Reg 3200 MHz RAM. Local storage with a total capacity of 3200 GB is organized on Samsung solid-state drives, designed specifically for data centers.
GPU NVIDIA H100 NVL 94GB
Accelerate your transition to a new era of Artificial Intelligence with the latest H100 Chips with fourth-generation tensor cores.
The H100 GPUs are equipped with fourth-generation tensor cores and the Transformer Engine with FP8 accuracy. This combination accelerates learning up to 9 times faster compared to the previous generation, specifically for Expert Team models (MoE).
The fourth-generation tensor cores accelerate all types of precision, including FP64, TF32, FP32, FP16, and INT8. The Transformer Engine utilizes both FP8 and FP16 to reduce memory usage and improve performance while maintaining accuracy for large language models.
| Video memory capacity |
94 GB |
| Type of video memory |
HBM3 |
| Memory bandwidth |
4 TB/s |
| Tensor cores |
4th generation |
| Driver support |
R535 or later |
GPU performance benchmarks
Performance benchmarks results in a virtual environment for 1 NVIDIA H100 NVL 94GB graphics card.
-
Matrix multiply example
GFlop/s
-
Hashcat bcrypt
H/s
100% Performance
Each physical core or GPU adapter is dedicated to a single client.
This means:
- 100% vCPU time is available;
- Physical pass-through of GPUs inside virtual servers;
- Reduced storage and network load on hypervisors, delivering more storage and network performance to clients.
Up to 75,000 IOPS1 for RANDOM READ and up to 20,000 IOPS for RANDOM WRITE on Virtual Servers with local SSDs
Up to 70 000 IOPS1 for RANDOM READ and up to 60 000 IOPS for RANDOM WRITE on Virtual Servers with block storage volumes
You can be confident that Virtual Servers do not share vCPU or GPU resources with one another.
Ready-made OS images with the required software
Create virtual servers by utilizing our pre-configured OS images with either Windows or Linux, along with specialized pre-installed software.
View all the pre-installed images
in the Marketplace.
Pure OpenStack API
Developers and system administrators can manage the cloud using the full OpenStack API.
Authenticate ninja_user example:
$ curl -g -i -X POST https://api.immers.cloud:5000/v3/auth/tokens \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-d '{"auth": {"identity": {"methods": ["password"], "password": {"user": { "name": "ninja_user", "password": "ninja_password", "domain": {"id": "default"}}}}, "scope": {"project": {"name": "ninja_user", "domain": {"id": "default"}}}}}'
Create ninja_vm example:
$ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"server": {"name": "ninja_vm", "imageRef": "8b85e210-d2c8-490a-a0ba-dc17183c0223", "key_name": "mykey01", "flavorRef": "8f9a148d-b258-42f7-bcc2-32581d86e1f1", "max_count": 1, "min_count": 1, "networks": [{"uuid": "cc5f6f4a-2c44-44a4-af9a-f8534e34d2b7"}]}}'
STOP ninja_vm example:
$ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers/{server_id}/action \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"os-stop" : null}'
START ninja_vm example:
$ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers/{server_id}/action \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"os-start" : null}'
SHELVE ninja_vm example:
$ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers/{server_id}/action \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"shelve" : null}'
DELETE ninja_vm example:
$ curl -g -i -X DELETE https://api.immers.cloud:8774/v2.1/servers/{server_id} \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN"
Documentation
Subscribe to our newsletter
Get notifications about new promotions and special offers by email.
