H200 GPU instances
Accelerate your AI projects with H200 GPU instances
High-performance for training, inference, and intensive data workloads in a reliable and transparent European cloud.
Why choose NVIDIA H200 GPUs?
Powerful
Up to 1.4 times faster than the H100 for training and inference of GenAI models.
High performance
141 GB of ultra-fast HBM3e memory: double the memory bandwidth and ideal for large models.
Compatible
H100-compatible: leverage your existing frameworks and optimisations without the need for complex migration.
Sovereign
Available in our Public Cloud, ensuring flexibility, transparency, and compliance with European standards.
Optimised for your AI and data workloads
Ultra-large-scale LLM
Train and deploy models with up to 175B of parameters (GPT-3, Llama 3, Falcon 180B), using its 141 GB of HBM3e memory and 4.8 TB/s bandwidth.
Advanced generative AI
Generate text, image, audio, and video with stable response times, even for long contexts.
Extended context and RAG
Enhance your AI assistants and chatbots with long context windows.
Specifications
Technical specifications
GPU
1–8 GPUs per instance
GPU memory
141 GB of ultra-fast HBM3 per GPU
High-performance storage
Local NVMe passthrough on most instances
Public and private network
Up to 25 Gbps included
Automation
Management via your Control Panel, API, OVHcloud CLI, etc.
Secure and private
ISO27001, SOC certifications, health data hosting.
Maximise your ROI with flexible GPU infrastructure
Pricing transparency
Pay only for the resources you use, with no hidden fees. Maintain control over your costs while enjoying optimal performance.
Instant scalability
Scale up or down your GPU resources on demand, in just a few clicks. Easily adapt your capacity to AI and data workloads.
Sovereignty and compliance
Your data is hosted in a secure, transparent, and compliant European cloud, certified to meet regulations (GDPR, ISO, HDS).
Barrier-free accessibility
Open and accessible H200 GPUs — from proof of concept to production deployment, with no limitations on how many you need or the type of hardware used.
How to choose your GPU for inference?
Compact models
The A100, with up to 7B of parameters, offers an excellent price/performance ratio.
Large models
From 65B+ or extended pop-ups, the H200 provides the memory bandwidth needed for stable response times.
Configure your GPU instances
Your questions answered
What service level agreement (SLA) is guaranteed by OVHcloud on a GPU instance?
The SLA guarantees 99.99% monthly availability on GPU instances. For further information, please refer to the General Terms of Service.
Which hypervisor is used for instance virtualisation?
Just like other instances, GPU instances are virtualised by the KVM hypervisor in the Linux kernel.
What is PCI Passthrough?
Cards with GPUs are served via the physical server’s PCI bus. PCI Passthrough is a hypervisor feature that allows you to dedicate hardware to a virtual machine by giving direct access to the PCI bus, without going through virtualisation.
Can I resize a Cloud GPU instance?
Yes, Cloud GPU instances can be upgraded to a higher model after a reboot. However, they cannot be downgraded to a lower model.
Do GPU instances have anti-DDoS protection?
Yes, our anti-DDoS protection is included with all OVHcloud solutions at no extra cost.
Can I switch to hourly billing from an instance that is billed monthly?
If you have monthly billing set up, you cannot switch to hourly billing. Before you launch an instance, please take care to select the billing method that is best suited to your project.
What is a Cloud GPU?
A Cloud GPU is a cloud computing service that provides graphic processing units (GPUs) for tasks that require high computing power. Examples of these are graphic rendering, machine learning, data analysis, and scientific simulations. Unlike on-premises GPUs, which require a significant investment in hardware, cloud GPUs are more flexible and easier to scale. Users can access high-performance computing resources on demand, and only pay for what they use.
What is an H100 and A100 server?
Servers that are equipped with NVIDIA H100 and A100 GPUs are purpose-built to offer exceptional performance in HPC, AI, and data analytics.
What is NGC?
NVIDIA GPU Cloud (NGC) is a cloud computing platform offered by NVIDIA. It provides a comprehensive selection of software that is optimised for GPU acceleration in artificial intelligence (AI), machine learning (ML), and high-performance computing (HPC). NGC simplifies and speeds up the deployment of AI and scientific computing applications. It does this by providing containers, pre-trained models, SDKs, and other tools that are optimised to leverage NVIDIA GPUs.
Why use a Cloud GPU?
There are several advantages to using a Cloud GPU, especially for companies, R&D, and development teams in demanding fields, such as artificial intelligence (AI), graphics rendering, machine learning (ML), and high-performance computing (HPC).