Chip leaderboard
Most HBM memory per chip
SambaNova SN40L leads at 1,500 GB. 48 chips ranked.
How much high-bandwidth memory each chip has. This is the ceiling on the largest model that fits on one chip without splitting. Cerebras WSE-3 lists on-die SRAM, not HBM, but it's included since the question is capacity.
| # | Chip | Value | Inputs |
|---|---|---|---|
| 1 | SambaNova SN40L SambaNova Systems | 1,500 GB | Type: DDR5 (three-tier: 64 MB SRAM + 64 GB HBM3 + 1.5 TB DDR5) |
| 2 | AMD Instinct MI400 AMD | 432 GB | Type: HBM4 |
| 3 | NVIDIA GB200 Grace Blackwell Superchip NVIDIA | 384 GB | Type: HBM3e |
| 4 | AMD Instinct MI350 series AMD | 288 GB | Type: HBM3e |
| 5 | AMD Instinct MI355X AMD | 288 GB | Type: HBM3e |
| 6 | NVIDIA B300 (Blackwell Ultra) NVIDIA | 288 GB | Type: HBM3e |
| 7 | NVIDIA GB300 (Blackwell Ultra) NVIDIA | 288 GB | Type: HBM3e |
| 8 | NVIDIA Rubin (R100) NVIDIA | 288 GB | Type: HBM4 |
| 9 | AMD Instinct MI325X AMD | 256 GB | Type: HBM3e |
| 10 | AMD Instinct MI300X AMD | 192 GB | Type: HBM3 |
| 11 | Google TPU v7 (Ironwood) Google | 192 GB | Type: HBM3e |
| 12 | Huawei Ascend 910D Huawei | 192 GB | Type: HBM3 |
| 13 | NVIDIA B100 (Blackwell) NVIDIA | 192 GB | Type: HBM3e |
| 14 | NVIDIA B200 (Blackwell) NVIDIA | 192 GB | Type: HBM3e |
| 15 | NVIDIA GH200 Grace Hopper Superchip NVIDIA | 144 GB | Type: HBM3e |
| 16 | NVIDIA H200 Tensor Core GPU NVIDIA | 141 GB | Type: HBM3e |
| 17 | AMD Instinct MI250X AMD | 128 GB | Type: HBM2e |
| 18 | Huawei Ascend 910C Huawei | 128 GB | Type: HBM2e |
| 19 | Intel Gaudi 3 Intel Corporation | 128 GB | Type: HBM2e |
| 20 | Meta MTIA v2 Meta | 128 GB | Type: LPDDR5 |
| 21 | NVIDIA DRIVE Thor NVIDIA | 128 GB | Type: LPDDR5X |
| 22 | NVIDIA Jetson AGX Thor NVIDIA | 128 GB | Type: LPDDR5X |
| 23 | AWS Trainium 2 Amazon | 96 GB | Type: HBM3 |
| 24 | Intel Gaudi 2 Intel Corporation | 96 GB | Type: HBM2e |
| 25 | NVIDIA H20 NVIDIA | 96 GB | Type: HBM3 |
| 26 | Google TPU v5p Google | 95 GB | Type: HBM2e |
| 27 | NVIDIA A100 Tensor Core GPU NVIDIA | 80 GB | Type: HBM2e |
| 28 | NVIDIA A800 NVIDIA | 80 GB | Type: HBM2e |
| 29 | NVIDIA H100 Tensor Core GPU NVIDIA | 80 GB | Type: HBM3 |
| 30 | NVIDIA H800 NVIDIA | 80 GB | Type: HBM3 |
| 31 | Biren BR100 Biren Technology | 64 GB | Type: HBM2e |
| 32 | Huawei Ascend 910B Huawei | 64 GB | Type: HBM2e |
| 33 | NVIDIA Jetson AGX Orin NVIDIA | 64 GB | Type: LPDDR5 |
| 34 | Cambricon MLU370-X8 Cambricon Technologies | 48 GB | Type: LPDDR5 |
| 35 | NVIDIA L40S NVIDIA | 48 GB | Type: GDDR6 |
| 36 | Cerebras WSE-3 (Wafer-Scale Engine 3) Cerebras Systems | 44 GB | Type: on-die SRAM |
| 37 | AWS Inferentia 2 Amazon | 32 GB | Type: HBM3 |
| 38 | AWS Trainium (Trn1) Amazon | 32 GB | Type: HBM2e |
| 39 | Google TPU v4 Google | 32 GB | Type: HBM2 |
| 40 | Google TPU v6 (Trillium) Google | 32 GB | Type: HBM3 |
| 41 | NVIDIA V100 Tensor Core GPU NVIDIA | 32 GB | Type: HBM2 |
| 42 | Tenstorrent Blackhole Tenstorrent | 32 GB | Type: GDDR6 |
| 43 | NVIDIA A10 Tensor Core GPU NVIDIA | 24 GB | Type: GDDR6 |
| 44 | Google TPU v5e Google | 16 GB | Type: HBM2 |
| 45 | NVIDIA T4 Tensor Core GPU NVIDIA | 16 GB | Type: GDDR6 |
| 46 | Tesla HW4 (FSD Computer 2) Tesla | 16 GB | Type: GDDR6 |
| 47 | Tenstorrent Wormhole Tenstorrent | 12 GB | Type: GDDR6 |
| 48 | Groq LPU (Language Processing Unit) Groq | 0.23 GB | Type: SRAM (230 MB on-die) |
48 chips ranked. 12 more are in our catalog but don't publish the numbers needed for this ranking.
Other rankings: Best perf-per-watt (TFLOPS/W) · Highest memory bandwidth · Highest FP8 dense throughput · Highest FP16 dense throughput · Highest INT8 dense throughput · Cheapest per TFLOP at launch (list price) · Most transistors per die
See also: every chip on record · head-to-head comparisons.