AvailableBlackwell2024

GB200 NVL72

NVIDIA's flagship rack-scale AI system with 72 Blackwell GPUs and 36 Grace CPUs. Designed for trillion-parameter model training.

GB200 NVL72 GPU

Technical Specifications

Architecture
Blackwell
Release Year
2024
Process Node
TSMC 4NP
Form Factor
NVL72 rack (72 GPUs)
VRAM
13,824 GB HBM3e (192 GB per GPU × 72)
Memory Bandwidth
8.0 TB/s per GPU
Interconnect
NVLink 5 (1.8 TB/s per GPU)
FP16 Performance
720 PFLOPS (rack-level)
TDP
1,000W per GPU
CUDA Cores
18,432 per GPU
Transistors
208 billion
Die Size
1,590 mm²

Best Use Cases

  • Trillion-parameter LLM training
  • Exascale HPC
  • AI factories

Quick Facts

FamilyBlackwell
ArchitectureBlackwell
Released2024
ProcessTSMC 4NP
Form FactorNVL72 rack (72 GPUs)

Related Blackwell GPUs

GB200 NVL72 — Frequently Asked Questions

What is the GB200 NVL72 GPU used for?

The GB200 NVL72 is best suited for: Trillion-parameter LLM training, Exascale HPC, AI factories.

How much VRAM does the GB200 NVL72 have?

The GB200 NVL72 has 13,824 GB HBM3e (192 GB per GPU × 72) of VRAM.

What is the memory bandwidth of the GB200 NVL72?

The GB200 NVL72 has a memory bandwidth of 8.0 TB/s per GPU.

What interconnect does the GB200 NVL72 use?

The GB200 NVL72 uses NVLink 5 (1.8 TB/s per GPU).

When was the GB200 NVL72 released?

The GB200 NVL72 was released in 2024.