AvailableHopper • 2023
H100 NVL
PCIe variant of H100 with 94GB HBM3 (more VRAM than SXM version). Uses NVLink bridge for multi-GPU on PCIe.
Technical Specifications
Architecture | Hopper |
Release Year | 2023 |
Process Node | TSMC 4N |
Form Factor | PCIe Gen5 (dual-slot) |
VRAM | 94 GB HBM3 |
Memory Bandwidth | 3.9 TB/s |
Interconnect | NVLink 4 (900 GB/s) — PCIe card with NVLink bridge |
FP16 Performance | 1,979 TFLOPS (with sparsity) |
FP32 Performance | 67 TFLOPS |
FP64 Performance | 34 TFLOPS |
TDP | 350W |
CUDA Cores | 16,896 |
Tensor Cores | 528 |
Transistors | 80 billion |
Die Size | 814 mm² |
Best Use Cases
- AI training
- LLM inference
- HPC
- Environments without SXM support
Quick Facts
FamilyHopper
ArchitectureHopper
Released2023
ProcessTSMC 4N
Form FactorPCIe Gen5 (dual-slot)
Related Hopper GPUs
H100 NVL — Frequently Asked Questions
What is the H100 NVL GPU used for?
The H100 NVL is best suited for: AI training, LLM inference, HPC, Environments without SXM support.
How much VRAM does the H100 NVL have?
The H100 NVL has 94 GB HBM3 of VRAM.
What is the memory bandwidth of the H100 NVL?
The H100 NVL has a memory bandwidth of 3.9 TB/s.
What interconnect does the H100 NVL use?
The H100 NVL uses NVLink 4 (900 GB/s) — PCIe card with NVLink bridge.
When was the H100 NVL released?
The H100 NVL was released in 2023.