AvailableHopper2023

H100 NVL

PCIe variant of H100 with 94GB HBM3 (more VRAM than SXM version). Uses NVLink bridge for multi-GPU on PCIe.

Technical Specifications

Architecture
Hopper
Release Year
2023
Process Node
TSMC 4N
Form Factor
PCIe Gen5 (dual-slot)
VRAM
94 GB HBM3
Memory Bandwidth
3.9 TB/s
Interconnect
NVLink 4 (900 GB/s) — PCIe card with NVLink bridge
FP16 Performance
1,979 TFLOPS (with sparsity)
FP32 Performance
67 TFLOPS
FP64 Performance
34 TFLOPS
TDP
350W
CUDA Cores
16,896
Tensor Cores
528
Transistors
80 billion
Die Size
814 mm²

Best Use Cases

  • AI training
  • LLM inference
  • HPC
  • Environments without SXM support

Quick Facts

FamilyHopper
ArchitectureHopper
Released2023
ProcessTSMC 4N
Form FactorPCIe Gen5 (dual-slot)

Related Hopper GPUs

H100 NVL — Frequently Asked Questions

What is the H100 NVL GPU used for?

The H100 NVL is best suited for: AI training, LLM inference, HPC, Environments without SXM support.

How much VRAM does the H100 NVL have?

The H100 NVL has 94 GB HBM3 of VRAM.

What is the memory bandwidth of the H100 NVL?

The H100 NVL has a memory bandwidth of 3.9 TB/s.

What interconnect does the H100 NVL use?

The H100 NVL uses NVLink 4 (900 GB/s) — PCIe card with NVLink bridge.

When was the H100 NVL released?

The H100 NVL was released in 2023.