AvailableBlackwell • 2024
GB200 NVL72
NVIDIA's flagship rack-scale AI system with 72 Blackwell GPUs and 36 Grace CPUs. Designed for trillion-parameter model training.
Technical Specifications
Architecture | Blackwell |
Release Year | 2024 |
Process Node | TSMC 4NP |
Form Factor | NVL72 rack (72 GPUs) |
VRAM | 13,824 GB HBM3e (192 GB per GPU × 72) |
Memory Bandwidth | 8.0 TB/s per GPU |
Interconnect | NVLink 5 (1.8 TB/s per GPU) |
FP16 Performance | 720 PFLOPS (rack-level) |
TDP | 1,000W per GPU |
CUDA Cores | 18,432 per GPU |
Transistors | 208 billion |
Die Size | 1,590 mm² |
Best Use Cases
- Trillion-parameter LLM training
- Exascale HPC
- AI factories
Quick Facts
FamilyBlackwell
ArchitectureBlackwell
Released2024
ProcessTSMC 4NP
Form FactorNVL72 rack (72 GPUs)
Related Blackwell GPUs
GB200 NVL72 — Frequently Asked Questions
What is the GB200 NVL72 GPU used for?
The GB200 NVL72 is best suited for: Trillion-parameter LLM training, Exascale HPC, AI factories.
How much VRAM does the GB200 NVL72 have?
The GB200 NVL72 has 13,824 GB HBM3e (192 GB per GPU × 72) of VRAM.
What is the memory bandwidth of the GB200 NVL72?
The GB200 NVL72 has a memory bandwidth of 8.0 TB/s per GPU.
What interconnect does the GB200 NVL72 use?
The GB200 NVL72 uses NVLink 5 (1.8 TB/s per GPU).
When was the GB200 NVL72 released?
The GB200 NVL72 was released in 2024.