Cloud servers with NVIDIA V100

Cost-Effective Model Inference and Classic HPC Workloads

GPU Servers with NVIDIA Tesla V100

Introduced in 2017, the NVIDIA Volta architecture (Tesla V100) faces significant limitations for training or fine-tuning modern Large Language Models (LLMs). This is primarily due to its limited VRAM capacity (16 GB or 32 GB) and the lack of native hardware support for modern compute precision formats like TF32, BF16, and FP8.

Nevertheless, V100-based configurations remain highly viable for a specific set of workloads where budget optimization is critical, and demands for raw compute power and memory bandwidth are moderate:

  • Small-Scale Model Inference: Deploying lightweight models that do not require massive amounts of VRAM.
  • Legacy Environments: Running legacy codebases and specialized enterprise software certified specifically for the Volta architecture.
  • Foundational HPC Workloads: Numerical methods and simulations (e.g., molecular dynamics) that parallelize efficiently but do not bottleneck on HBM2 memory bandwidth.
  • Development and Debugging: Testing pipeline logic and writing code before scaling up workloads to higher-performance configurations (such as H100 or H200).

Hardware Specifications for Tesla V100 Servers

All NVIDIA Tesla V100 compute nodes at immers.cloud are built on robust, enterprise-grade architecture:

  • Processors: Dual Intel® Xeon® Gold 6240R processors, featuring a 2.4 GHz base clock with dynamic boosting up to 4.0 GHz via Intel® Turbo Boost Technology.
  • ML Optimization: Each processor features dual Intel® AVX-512 units and supports Intel® AVX-512 Deep Learning Boost. This instruction set significantly accelerates low-precision multiply-and-add operations, which are critical for the inner loops of deep learning algorithms.
  • Memory: Up to 3,072 GB of 2933 MHz DDR4 ECC Registered RAM. Error-Correcting Code (ECC) support guarantees data integrity during extended computational sessions.
  • Storage Subsystem: Up to 1,920 GB of local storage powered by enterprise-grade Intel® Data Center SSDs. This ensures the high I/O throughput and reliability required for handling massive datasets.

GPU Tesla V100

When NVIDIA introduced the Volta architecture and the V100 GPU in 2017, the market was highly skeptical. The generative AI boom had not yet begun, and many industry experts questioned the viability of dedicating specialized silicon (Tensor Cores) exclusively to matrix computations. At the time, many researchers believed that general-purpose CUDA cores were entirely sufficient, and that the inclusion of expensive HBM2 memory would make the final product too niche.

However, this strategic bet paid off handsomely. The V100 was the world’s first GPU to feature Tensor Cores, laying the foundational hardware blueprint for every subsequent generation of AI accelerators, from Turing to Blackwell. The architectural refinements pioneered in the V100 directly informed the design of more powerful neural network accelerators. It definitively proved that hardware specialization for linear algebra delivers multiplicative performance gains over general-purpose computing.

The Tesla V100 is a legendary architecture that ushered in the modern era of hardware-accelerated deep learning. While it is not intended to tackle the bleeding-edge workloads designed for the latest generation of chips, it remains a highly reliable, predictable, and cost-effective solution for its target class of workloads.

Video memory capacity 32 GB
Type of video memory HBM2 (ECC)
Memory bandwidth 900 Gb/s
Tensor cores 640
CUDA cores 5120

GPU performance benchmarks

Performance benchmarks results in a virtual environment for 1 Tesla V100 graphics card.
  • OctaneBench 2020

    up to
    360
    pts
  • Matrix multiply example

    2430
    GFlop/s
  • Hashcat bcrypt

    46 600
    H/s

Basic configurations with Tesla V100 32 GB

Prices:
Name vCPU RAM, MB Disk, GB GPU Price, hour
teslav100-1.8.16.128 8 16384 128 1 $1.08 Launch
teslav100-1.8.64.60 8 65536 60 1 $1.17 Launch
teslav100-1.8.64.80 8 65536 80 1 $1.17 Launch
teslav100-1.8.64.160 8 65536 160 1 $1.18 Launch
teslav100-1.8.64.320 8 65536 320 1 $1.20 Launch
teslav100-1.12.64.160 12 65536 160 1 $1.20 Launch
teslav100-1.16.64.160 16 65536 160 1 $1.23 Launch
teslav100-1.16.64.200 16 65536 200 1 $1.23 Launch
teslav100-1.16.64.320 16 65536 320 1 $1.25 Launch
teslav100-1.16.128.160 16 131072 160 1 $1.36 Launch
teslav100-1.32.128.160 32 131072 160 1 $1.45 Launch
teslav100-1.64.256.320 64 262144 320 1 $1.92 Launch
teslav100-2.8.64.240 8 65535 240 2 $2.17 Launch
teslav100-2.16.64.240 16 65535 240 2 $2.22 Launch
teslav100-2.32.128.160 32 131072 160 2 $2.44 Launch
teslav100-2.32.128.320 32 131072 320 2 $2.46 Launch
teslav100-2.32.192.160 32 196608 160 2 $2.56 Launch
teslav100-2.32.192.320 32 196608 320 2 $2.58 Launch
teslav100-2.32.256.320 32 262144 320 2 $2.71 Launch
teslav100-3.64.256.320 64 262144 320 3 $3.89 Launch
teslav100-4.32.64.160 32 65536 160 4 $4.28 Launch
teslav100-4.32.96.160 32 98304 160 4 $4.35 Launch
teslav100-4.32.256.160 32 262144 160 4 $4.66 Launch
teslav100-4.32.256.320 32 262144 320 4 $4.68 Launch
↔

GPU Feature Comparison

Feature NVIDIA RTX 4090 NVIDIA Tesla V100 NVIDIA A100 NVIDIA H100
Architecture Ada Lovelace Volta Ampere Hopper
VRAM Capacity 24 GB (GDDR6X) 32 GB (HBM2) 80 GB (HBM2e) 80 GB (HBM3)
Memory Bandwidth 1 008 Gb/s 900 Gb/s 2 039 Gb/s 3 350 Gb/s
AI Tensor Performance High (FP16 / BF16)* ~125 TFLOPS (FP16) ~312 TFLOPS (TF32) ~989 TFLOPS (TF32) / 1 979 (FP8)
ECC Memory Support No Yes Yes Yes
Best for Cost-effective inference, 3D rendering, and running small local LLMs (up to 13B parameters) Inference of small or heavily quantized models, debugging ML pipelines before scaling, and running legacy code. Not suitable for training modern LLMs (lacks TF32/BF16 support, limited VRAM) Training and fine-tuning large language models (LLMs), and complex scientific simulations Training massive LLMs, extreme HPC workloads, and achieving maximum compute throughput

100% Performance

Each physical core or GPU adapter is dedicated to a single client.
This means:

  • 100% vCPU time is available;
  • Physical pass-through of GPUs inside virtual servers;
  • Reduced storage and network load on hypervisors, delivering more storage and network performance to clients.

Up to 75,000 IOPS1 for RANDOM READ and up to 20,000 IOPS for RANDOM WRITE on Virtual Servers with local SSDs

Up to 70 000 IOPS1 for RANDOM READ and up to 60 000 IOPS for RANDOM WRITE on Virtual Servers with block storage volumes

Advanced immersion cooling technology maintains optimal processor temperatures, ensuring stability and maximum turbo boost frequencies across all CPU and GPU cores.

  1. IOPS — Input/Output Operations Per Second.

Answers to frequently asked questions

You can host a virtual server for any duration. Simply make a payment starting from 1.1 $ and work within the prepaid balance. When you're finished, delete the server to stop incurring charges.

Yes, you can create GPU-servers through the control panel by choosing the hardware configuration and operating system. The ordered resources will be available for use within a few minutes.

If something goes wrong, contact our tech support. We are available 24/7: https://t.me/immerscloudsupport.

You can choose from the following basic images: Windows Server 2019, Windows Server 2022, Ubuntu, Debian, CentOS, Fedora, and OpenSUSE, or use a pre-configured image from the Marketplace.

All operating systems are installed automatically when the GPU-server is created.

By default, we provide RDP access for Windows-based servers and SSH access for Linux-based servers.

You can configure any connection method that is convenient for you.

Yes, it is possible. Contact our 24/7 support service (at https://t.me/immerscloudsupport} and tell us your desired configuration.

6 Reasons Why immers.cloud Is the Best GPU Cloud

  • Pay-as-you-go billing

    and free VM pause (shelve). You only pay for the actual use of your VMs
  • 24/7/365 Tech Support

    Tech support is always available via chat and responds within minutes

  • Free traffic

    Speeds up to 20 Gb/s with no extra charge for incoming or outgoing traffic

  • Our Data Centers

    Built to TIER III standards
  • 100% of power is yours

    We do not share resources you purchased with other users
  • 29000+

    Users trust us with their data and tasks
Sign up

Ready-made OS images with the required software

Create virtual servers by utilizing our pre-configured OS images with either Windows or Linux, along with specialized pre-installed software.
  • Ubuntu
     
  • Debian
     
  • CentOS
     
  • Fedora
     
  • OpenSUSE
     
  • MS Windows Server
     
  • OpenClaw
     
  • Open WebUI
     
  • OpenCode
     
  • LibreChat
     
  • Stable Diffusion
     
  • Flux
     
  • 3ds Max
     
  • Cinema 4D
     
  • Corona
     
  • Deadline
     
  • Blender
     
  • Nginx
     
  • Apache
     
  • Git
     
  • Jupyter
     
  • Django
     
  • MySQL
     
View all the pre-installed images in the Marketplace.

Pure OpenStack API

Developers and system administrators can manage the cloud using the full OpenStack API.
Authenticate ninja_user example: $ curl -g -i -X POST https://api.immers.cloud:5000/v3/auth/tokens \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-d '{"auth": {"identity": {"methods": ["password"], "password": {"user": { "name": "ninja_user", "password": "ninja_password", "domain": {"id": "default"}}}}, "scope": {"project": {"name": "ninja_user", "domain": {"id": "default"}}}}}'
Create ninja_vm example: $ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"server": {"name": "ninja_vm", "imageRef": "8b85e210-d2c8-490a-a0ba-dc17183c0223", "key_name": "mykey01", "flavorRef": "8f9a148d-b258-42f7-bcc2-32581d86e1f1", "max_count": 1, "min_count": 1, "networks": [{"uuid": "cc5f6f4a-2c44-44a4-af9a-f8534e34d2b7"}]}}'
STOP ninja_vm example: $ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers/{server_id}/action \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"os-stop" : null}'
START ninja_vm example: $ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers/{server_id}/action \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"os-start" : null}'
SHELVE ninja_vm example: $ curl -g -i -X POST https://api.immers.cloud:8774/v2.1/servers/{server_id}/action \
-H "Accept: application/json" \
-H "Content-Type: application/json" \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN" \
-d '{"shelve" : null}'
DELETE ninja_vm example: $ curl -g -i -X DELETE https://api.immers.cloud:8774/v2.1/servers/{server_id} \
-H "User-Agent: YOUR-USER-AGENT" \
-H "X-Auth-Token: YOUR-API-TOKEN"
Documentation
Signup

Any questions?

Write to us via live chat, email, or call by phone:
@immerscloudsupport
support@immers.cloud
+7 499 110-44-94

Any questions?

Write to us via live chat, email, or call by phone:
@immerscloudsupport support@immers.cloud +7 499 110-44-94
Sign up

Subscribe to our newsletter

Get notifications about new promotions and special offers by email.

 I agree to the processing of personal data
We use cookies and web analytics services to ensure the proper functioning of the website, analyze web-site traffic, and improve the quality of our services.
By continuing to use the website, you consent to the Privacy Policy and consent to the processing of cookie files and technical data.