Capability
Historical Token Throughput per GPU
Historical Token Throughput per GPU. Demo series compiled by The Latent research desk.
Historical Token Throughput per GPU
- H100 FP8
- H100 FP16
- MI300X FP8
View data
| Date | H100 FP8 | H100 FP16 | MI300X FP8 |
|---|---|---|---|
| 2026-06-01 | 25600.73 | 14471.17 | 20814.87 |
| 2026-07-01 | 25466.71 | 14413.65 | 20758.43 |
API access · Pro coming soon
Demo preview through July 2026 (tokens per second).
Methodology
Synthetic demo series generated to preview the data product layout.