AvailableBlackwell2024

GB200 NVL72

NVIDIA's flagship rack-scale AI system with 72 Blackwell GPUs and 36 Grace CPUs. Designed for trillion-parameter model training.

Technical Specifications

Architecture
Blackwell
Release Year
2024
Process Node
TSMC 4NP
Form Factor
NVL72 rack (72 GPUs)
VRAM
13,824 GB HBM3e (192 GB per GPU × 72)
Memory Bandwidth
8.0 TB/s per GPU
Interconnect
NVLink 5 (1.8 TB/s per GPU)
FP16 Performance
720 PFLOPS (rack-level)
TDP
1,000W per GPU
CUDA Cores
18,432 per GPU
Transistors
208 billion
Die Size
1,590 mm²

Best Use Cases

  • Trillion-parameter LLM training
  • Exascale HPC
  • AI factories

Quick Facts

FamilyBlackwell
ArchitectureBlackwell
Released2024
ProcessTSMC 4NP
Form FactorNVL72 rack (72 GPUs)

Related Blackwell GPUs

GB200 NVL72 — Frequently Asked Questions

What is the GB200 NVL72 GPU used for?

The GB200 NVL72 is best suited for: Trillion-parameter LLM training, Exascale HPC, AI factories.

How much VRAM does the GB200 NVL72 have?

The GB200 NVL72 has 13,824 GB HBM3e (192 GB per GPU × 72) of VRAM.

What is the memory bandwidth of the GB200 NVL72?

The GB200 NVL72 has a memory bandwidth of 8.0 TB/s per GPU.

What interconnect does the GB200 NVL72 use?

The GB200 NVL72 uses NVLink 5 (1.8 TB/s per GPU).

When was the GB200 NVL72 released?

The GB200 NVL72 was released in 2024.