AI chip · NVIDIA
NVIDIA GH200 Grace Hopper Superchip
NVIDIA's first Grace Hopper Superchip: a 72-core Grace Arm CPU tied to a Hopper GPU over 900 GB/s NVLink-C2C, with up to 480 GB LPDDR5X and 144 GB HBM3e. The root of NVIDIA's Grace-based superchip line.
Market position
NVIDIA's first Grace Hopper Superchip: a 72-core Grace Arm CPU joined to a Hopper GPU over 900 GB/s NVLink-C2C, with up to 480 GB LPDDR5X + 144 GB HBM3e. Root of NVIDIA's superchip line (GH200 to GB200 to GB300), distinct from the discrete SXM GPU line (H100 to H200 to B200 to B300 to Rubin).
What fits in 144 GB
Which open-source LLMs run on one NVIDIA GH200 Grace Hopper Superchip, by precision. Weights only: add roughly 15% headroom for real serving. If a model does not fit at FP16, try INT8 or INT4 (smaller quality trade-off than most people expect).
| Model | Params | FP16 | INT8 | INT4 |
|---|---|---|---|---|
| Llama 3.1 8B dense | 8 B | 16 GB ✓ | 8 GB ✓ | 4 GB ✓ |
| Llama 3.1 70B dense | 70 B | 140 GB ✓ | 70 GB ✓ | 35 GB ✓ |
| Llama 3.1 405B dense | 405 B | 810 GB ✗ | 405 GB ✗ | 203 GB ✗ |
| Llama 3.3 70B dense | 70 B | 140 GB ✓ | 70 GB ✓ | 35 GB ✓ |
| DeepSeek V3 MoE (671B total, 37B active per token) | 671 B | 1342 GB ✗ | 671 GB ✗ | 336 GB ✗ |
| DeepSeek R1 MoE (671B total, 37B active per token) | 671 B | 1342 GB ✗ | 671 GB ✗ | 336 GB ✗ |
| Qwen 2.5 7B dense | 7 B | 14 GB ✓ | 7 GB ✓ | 4 GB ✓ |
| Qwen 2.5 72B dense | 72 B | 144 GB ✓ | 72 GB ✓ | 36 GB ✓ |
| Mixtral 8x7B MoE (46.7B total, 12.9B active per token) | 46.7 B | 93 GB ✓ | 47 GB ✓ | 23 GB ✓ |
| Mixtral 8x22B MoE (141B total, 39B active per token) | 141 B | 282 GB ✗ | 141 GB ✓ | 71 GB ✓ |
| Gemma 2 27B dense | 27 B | 54 GB ✓ | 27 GB ✓ | 14 GB ✓ |
| Command R+ dense | 104 B | 208 GB ✗ | 104 GB ✓ | 52 GB ✓ |
| Kimi K2 MoE (1T total, 32B active per token) | 1000 B | 2000 GB ✗ | 1000 GB ✗ | 500 GB ✗ |
Math: FP16 = params × 2 bytes; INT8 = params × 1 byte; INT4 = params × 0.5 bytes. MoE models sum every expert (full weights on disk), not the per-token active subset.
Common questions
How much does NVIDIA GH200 Grace Hopper Superchip cost?
NVIDIA GH200 Grace Hopper Superchip doesn't have a public launch list price. Vendors like this one usually price through direct sales rather than a public sheet. See list price per TFLOP for chips that do publish.
How much memory does NVIDIA GH200 Grace Hopper Superchip have?
144 GB of HBM3e, running at 4,900 GB/s. Straight from the vendor datasheet. See chips with the most memory for context.
Which open-source LLMs fit on one NVIDIA GH200 Grace Hopper Superchip?
Of 13 open-source LLMs we track, 7 fit at FP16, 9 at INT8, and 9 at INT4 (for example Llama 3.1 8B, Llama 3.1 70B and Llama 3.3 70B). Full table above with each model's memory need.
Key facts
- Class
- Compute SoC (AI accelerator)
- Designer
- NVIDIA
- Safety-critical?
- No (data-center inference / training)
- Record as of
- 2026-09-27
Specifications (6 fields, click to expand)
Straight from the vendor datasheet. Dense throughput shown first; sparse (2:4) numbers in parentheses where the vendor publishes them. Full datasheet linked below.
- Process node
- TSMC 4N
- Memory
- 144 GB HBM3e
- Memory bandwidth
- 4,900 GB/s
- Form factor
- Superchip
- Announced
- 2022-09-20
- Released
- 2023-05-01
Source: vendor datasheet
Generation
Foundry & process
- Process node
- TSMC 4N
Sources
Adoption rows appear as we confirm each chip-in-robot pairing from a public source. See every chip we track for the full catalog or the NVIDIA page.