AvailableBlackwell2024

HGX B200

8-GPU HGX server board with Blackwell GPUs. The standard for next-generation AI training servers.

Technical Specifications

Architecture
Blackwell
Release Year
2024
Process Node
TSMC 4NP
Form Factor
HGX (8-GPU server board)
VRAM
1,536 GB HBM3e (192 GB per GPU × 8)
Memory Bandwidth
8.0 TB/s per GPU
Interconnect
NVLink 5 (1.8 TB/s), NVSwitch
FP16 Performance
9 PFLOPS (8-GPU, dense)
FP32 Performance
90 TFLOPS per GPU
FP64 Performance
45 TFLOPS per GPU
TDP
1,000W per GPU
CUDA Cores
18,432 per GPU
Transistors
208 billion
Die Size
1,590 mm²

Best Use Cases

  • Large-scale AI training
  • LLM training (70B-405B+)
  • HPC

Quick Facts

FamilyBlackwell
ArchitectureBlackwell
Released2024
ProcessTSMC 4NP
Form FactorHGX (8-GPU server board)

Related Blackwell GPUs

HGX B200 — Frequently Asked Questions

What is the HGX B200 GPU used for?

The HGX B200 is best suited for: Large-scale AI training, LLM training (70B-405B+), HPC.

How much VRAM does the HGX B200 have?

The HGX B200 has 1,536 GB HBM3e (192 GB per GPU × 8) of VRAM.

What is the memory bandwidth of the HGX B200?

The HGX B200 has a memory bandwidth of 8.0 TB/s per GPU.

What interconnect does the HGX B200 use?

The HGX B200 uses NVLink 5 (1.8 TB/s), NVSwitch.

When was the HGX B200 released?

The HGX B200 was released in 2024.