AvailableHopper2022

H100 SXM

SXM5 form factor of H100. 80GB HBM3 with full NVLink 4 (900 GB/s). 700W TDP — the highest performance H100 variant for multi-GPU training.

Technical Specifications

Architecture
Hopper
Release Year
2022
Process Node
TSMC 4N
Form Factor
SXM5
VRAM
80 GB HBM3
Memory Bandwidth
3.35 TB/s
Interconnect
NVLink 4 (900 GB/s)
FP16 Performance
1,979 TFLOPS (with sparsity)
FP32 Performance
67 TFLOPS
FP64 Performance
34 TFLOPS
TDP
700W
CUDA Cores
16,896
Tensor Cores
528
Transistors
80 billion
Die Size
814 mm²

Best Use Cases

  • AI training
  • LLM training (70B+ params)
  • Multi-GPU training
  • HPC

Quick Facts

FamilyHopper
ArchitectureHopper
Released2022
ProcessTSMC 4N
Form FactorSXM5

Related Hopper GPUs

H100 SXM — Frequently Asked Questions

What is the H100 SXM GPU used for?

The H100 SXM is best suited for: AI training, LLM training (70B+ params), Multi-GPU training, HPC.

How much VRAM does the H100 SXM have?

The H100 SXM has 80 GB HBM3 of VRAM.

What is the memory bandwidth of the H100 SXM?

The H100 SXM has a memory bandwidth of 3.35 TB/s.

What interconnect does the H100 SXM use?

The H100 SXM uses NVLink 4 (900 GB/s).

When was the H100 SXM released?

The H100 SXM was released in 2022.