AvailableHopper2024

H200 NVL

NVL Gen5 form factor of H200. 141GB HBM3e but no NVLink — uses NVL Gen5 (128 GB/s) instead. Lower power (350W) for environments without SXM.

H200 NVL GPU

Technical Specifications

Architecture
Hopper
Release Year
2024
Process Node
TSMC 4N
Form Factor
PCIe Gen5 (NVL)
VRAM
141 GB HBM3e
Memory Bandwidth
4.8 TB/s
Interconnect
PCIe Gen5 (128 GB/s) — no NVLink
FP16 Performance
1,979 TFLOPS (with sparsity)
FP32 Performance
67 TFLOPS
FP64 Performance
34 TFLOPS
TDP
350W
CUDA Cores
16,896
Tensor Cores
528
Transistors
80 billion
Die Size
814 mm²

Best Use Cases

  • LLM inference
  • HPC
  • Environments without SXM support

Quick Facts

FamilyHopper
ArchitectureHopper
Released2024
ProcessTSMC 4N
Form FactorPCIe Gen5 (NVL)

Related Hopper GPUs

H200 NVL — Frequently Asked Questions

What is the H200 NVL GPU used for?

The H200 NVL is best suited for: LLM inference, HPC, Environments without SXM support.

How much VRAM does the H200 NVL have?

The H200 NVL has 141 GB HBM3e of VRAM.

What is the memory bandwidth of the H200 NVL?

The H200 NVL has a memory bandwidth of 4.8 TB/s.

What interconnect does the H200 NVL use?

The H200 NVL uses PCIe Gen5 (128 GB/s) — no NVLink.

When was the H200 NVL released?

The H200 NVL was released in 2024.