Chip leaderboard
Highest INT8 dense throughput
AMD Instinct MI350 series leads at 4,600 TOPS. 29 chips ranked.
Raw compute at INT8: the standard precision for serving inference. Dense throughput, not sparse.
29 chips ranked. 31 more are in our catalog but don't publish the numbers needed for this ranking.
Other rankings: Best perf-per-watt (TFLOPS/W) · Most HBM memory per chip · Highest memory bandwidth · Highest FP8 dense throughput · Highest FP16 dense throughput · Cheapest per TFLOP at launch (list price) · Most transistors per die
See also: every chip on record · head-to-head comparisons.