AvailableHopper • 2022
H100 SXM
SXM5 form factor of H100. 80GB HBM3 with full NVLink 4 (900 GB/s). 700W TDP — the highest performance H100 variant for multi-GPU training.
Technical Specifications
Architecture | Hopper |
Release Year | 2022 |
Process Node | TSMC 4N |
Form Factor | SXM5 |
VRAM | 80 GB HBM3 |
Memory Bandwidth | 3.35 TB/s |
Interconnect | NVLink 4 (900 GB/s) |
FP16 Performance | 1,979 TFLOPS (with sparsity) |
FP32 Performance | 67 TFLOPS |
FP64 Performance | 34 TFLOPS |
TDP | 700W |
CUDA Cores | 16,896 |
Tensor Cores | 528 |
Transistors | 80 billion |
Die Size | 814 mm² |
Best Use Cases
- AI training
- LLM training (70B+ params)
- Multi-GPU training
- HPC
Quick Facts
FamilyHopper
ArchitectureHopper
Released2022
ProcessTSMC 4N
Form FactorSXM5
Related Hopper GPUs
H100 SXM — Frequently Asked Questions
What is the H100 SXM GPU used for?
The H100 SXM is best suited for: AI training, LLM training (70B+ params), Multi-GPU training, HPC.
How much VRAM does the H100 SXM have?
The H100 SXM has 80 GB HBM3 of VRAM.
What is the memory bandwidth of the H100 SXM?
The H100 SXM has a memory bandwidth of 3.35 TB/s.
What interconnect does the H100 SXM use?
The H100 SXM uses NVLink 4 (900 GB/s).
When was the H100 SXM released?
The H100 SXM was released in 2022.