How much VRAM does the A100 SXM 40GB have?

The A100 SXM 40GB has 40 GB of HBM2 memory.

When was the A100 SXM 40GB released?

The A100 SXM 40GB was released in 2020 by NVIDIA, based on the Ampere architecture in the SXM form factor.

How much does it cost to rent the A100 SXM 40GB?

The A100 SXM 40GB rents for $0.721/hr at the cheapest marketplace, with a typical listing-weighted median of $0.756/hr across 3 marketplace partners. Updated daily.

Is the A100 SXM 40GB good for AI training or inference?

The A100 SXM 40GB delivers 312 FP16 TFLOPS (dense, no sparsity) with 40 GB of VRAM. Suited for large-model training and high-throughput inference.

Ai Mining Co.

Home/GPU Prices/A100 SXM 40GB/Specifications

NVIDIA · Ampere · 2020

A100 SXM 40GB
AIMC Specifications

Name: A100 SXM 40GB
Brand: NVIDIA
Availability: InStock

Complete technical reference: architecture, memory, performance, and live rental pricing.

Memory

40 GB

HBM2

Form Factor

SXM

Datacenter

FP16 Compute

312

TFLOPS (dense)

Track this GPU — Free Trial Open Cost Calculator

Live Rental Pricing

Current market pricing across all authorized partners, updated daily.

Cheapest

$0.72/hr

Typical (median)

$0.76/hr

Marketplaces

See full marketplace breakdown for A100 SXM 40GB

Full Specifications

Factual specifications from manufacturer datasheets.

Manufacturer	NVIDIA
Architecture	Ampere
Memory Capacity	40 GB
Memory Type	HBM2
Form Factor	SXM
Release Year	2020
GPU Class	Datacenter
FP16 TFLOPS (dense)	312
VRAM (compute)	40 GB

Architecture & Use Cases

Technical overview of the A100 SXM 40GB.

The NVIDIA A100 SXM 40GB is the original Ampere datacenter flagship, announced at GTC May 2020. It uses HBM2 memory delivering 1.6 TB/s of bandwidth, paired with the GA100 die's 6,912 CUDA cores and 432 third-generation Tensor Cores. The SXM4 form factor connects to NVIDIA's HGX A100 baseboard via NVLink 3.0 at 600 GB/s bidirectional bandwidth per link. Compute capabilities include 312 TFLOPS of tensor performance with TF32, BF16, FP64, and INT8 precision support. The 80GB variant launched later in 2020 with HBM2e and 2 TB/s bandwidth, but the 40GB SXM remains widely deployed in earlier HGX A100 systems. TDP is 400W.