NVIDIA Ampere

Mainstream (2020-2022)

Ampere GPU Family

NVIDIA Ampere is the most widely-deployed AI GPU architecture in the cloud. Featuring HBM2e memory, MIG (Multi-Instance GPU) support, and NVLink 3 interconnects, the A100 remains a workhorse for AI training and inference.

12 GPU models in this family

GPU Comparison

GPU ModelVRAMBandwidthInterconnectBest ForStarting PriceTDPYear
A10
PCIe Gen4
24 GB GDDR6600 GB/sPCIe Gen4 (64 GB/s)AI inference150W2021View
A100 NVLink
PCIe Gen4 (with NVLink bridge)
80 GB HBM2e2.0 TB/sNVLink 3 (600 GB/s) via NVLink bridgeAI training$50.50/hr300W2021View
A100 PCIe
PCIe Gen4 (no NVLink)
80 GB HBM2e2.0 TB/sPCIe Gen4 (64 GB/s) — no NVLinkAI inference$50.50/hr300W2021View
A100 SXM 80GB
SXM4
80 GB HBM2e2.0 TB/sNVLink 3 (600 GB/s)AI training$50.50/hr400W2021View
A16
PCIe Gen4
64 GB GDDR6 (16 GB × 4 GPUs)TBDPCIe Gen4VDI250W2021View
A2
PCIe Gen4 (single-slot, passive)
16 GB GDDR6200 GB/sPCIe Gen4 (64 GB/s)AI inference (light)40-60W2021View
A30
PCIe Gen4
24 GB HBM2933 GB/sNVLink 3 (600 GB/s)AI training (small models)165W2021View
RTX A4000
PCIe Gen4 (single-slot)
16 GB GDDR6448 GB/sPCIe Gen4 (64 GB/s)Workstation AI140W2021View
RTX A5000
PCIe Gen4
24 GB GDDR6768 GB/sPCIe Gen4 (64 GB/s)Workstation AI230W2021View
A100 SXM 40GB
SXM4
40 GB HBM2e1.55 TB/sNVLink 3 (600 GB/s)AI training$50.50/hr400W2020View
A40
PCIe Gen4
48 GB GDDR6696 GB/sPCIe Gen4 (64 GB/s)Graphics300W2020View
RTX A6000
PCIe Gen4
48 GB GDDR6768 GB/sPCIe Gen4 (64 GB/s) / NVLink BridgeWorkstation AI300W2020View