AvailableHopper • 2024
H200 SXM
SXM5 form factor of H200. 141GB HBM3e with full NVLink 4 (900 GB/s). Highest bandwidth Hopper variant for large model training.
Technical Specifications
Architecture | Hopper |
Release Year | 2024 |
Process Node | TSMC 4N |
Form Factor | SXM5 |
VRAM | 141 GB HBM3e |
Memory Bandwidth | 4.8 TB/s |
Interconnect | NVLink 4 (900 GB/s) |
FP16 Performance | 1,979 TFLOPS (with sparsity) |
FP32 Performance | 67 TFLOPS |
FP64 Performance | 34 TFLOPS |
TDP | 700W |
CUDA Cores | 16,896 |
Tensor Cores | 528 |
Transistors | 80 billion |
Die Size | 814 mm² |
Best Use Cases
- LLM training (70B+ params)
- HPC
- Large model inference
Quick Facts
FamilyHopper
ArchitectureHopper
Released2024
ProcessTSMC 4N
Form FactorSXM5
Related Hopper GPUs
H200 SXM — Frequently Asked Questions
What is the H200 SXM GPU used for?
The H200 SXM is best suited for: LLM training (70B+ params), HPC, Large model inference.
How much VRAM does the H200 SXM have?
The H200 SXM has 141 GB HBM3e of VRAM.
What is the memory bandwidth of the H200 SXM?
The H200 SXM has a memory bandwidth of 4.8 TB/s.
What interconnect does the H200 SXM use?
The H200 SXM uses NVLink 4 (900 GB/s).
When was the H200 SXM released?
The H200 SXM was released in 2024.