AvailableAmpere • 2020
A100 SXM 40GB
SXM4 form factor, 40GB HBM2e variant. Full NVLink 3 (600 GB/s). The original A100 for AI training and HPC.
Technical Specifications
Architecture | Ampere |
Release Year | 2020 |
Process Node | TSMC 7N |
Form Factor | SXM4 |
VRAM | 40 GB HBM2e |
Memory Bandwidth | 1.55 TB/s |
Interconnect | NVLink 3 (600 GB/s) |
FP16 Performance | 624 TFLOPS (with sparsity) |
FP32 Performance | 19.5 TFLOPS |
FP64 Performance | 9.7 TFLOPS |
TDP | 400W |
CUDA Cores | 6,912 |
Tensor Cores | 432 |
Transistors | 54.2 billion |
Die Size | 826 mm² |
Best Use Cases
- AI training
- HPC
- MIG workloads
Quick Facts
FamilyAmpere
ArchitectureAmpere
Released2020
ProcessTSMC 7N
Form FactorSXM4
Cloud Providers Offering A100 SXM 40GB
Related Ampere GPUs
A100 SXM 40GB — Frequently Asked Questions
What is the A100 SXM 40GB GPU used for?
The A100 SXM 40GB is best suited for: AI training, HPC, MIG workloads.
How much VRAM does the A100 SXM 40GB have?
The A100 SXM 40GB has 40 GB HBM2e of VRAM.
What is the memory bandwidth of the A100 SXM 40GB?
The A100 SXM 40GB has a memory bandwidth of 1.55 TB/s.
What interconnect does the A100 SXM 40GB use?
The A100 SXM 40GB uses NVLink 3 (600 GB/s).
When was the A100 SXM 40GB released?
The A100 SXM 40GB was released in 2020.