AvailableHopper2024

H200 SXM

SXM5 form factor of H200. 141GB HBM3e with full NVLink 4 (900 GB/s). Highest bandwidth Hopper variant for large model training.

Technical Specifications

Architecture
Hopper
Release Year
2024
Process Node
TSMC 4N
Form Factor
SXM5
VRAM
141 GB HBM3e
Memory Bandwidth
4.8 TB/s
Interconnect
NVLink 4 (900 GB/s)
FP16 Performance
1,979 TFLOPS (with sparsity)
FP32 Performance
67 TFLOPS
FP64 Performance
34 TFLOPS
TDP
700W
CUDA Cores
16,896
Tensor Cores
528
Transistors
80 billion
Die Size
814 mm²

Best Use Cases

  • LLM training (70B+ params)
  • HPC
  • Large model inference

Quick Facts

FamilyHopper
ArchitectureHopper
Released2024
ProcessTSMC 4N
Form FactorSXM5

Related Hopper GPUs

H200 SXM — Frequently Asked Questions

What is the H200 SXM GPU used for?

The H200 SXM is best suited for: LLM training (70B+ params), HPC, Large model inference.

How much VRAM does the H200 SXM have?

The H200 SXM has 141 GB HBM3e of VRAM.

What is the memory bandwidth of the H200 SXM?

The H200 SXM has a memory bandwidth of 4.8 TB/s.

What interconnect does the H200 SXM use?

The H200 SXM uses NVLink 4 (900 GB/s).

When was the H200 SXM released?

The H200 SXM was released in 2024.