Capability
Historical Inference Speeds
Historical Inference Speeds. Demo series compiled by The Latent research desk.
Historical Inference Speeds
- Groq
- OpenAI
- Anthropic
View data
| Date | Groq | OpenAI | Anthropic | |
|---|---|---|---|---|
| 2023-08-01 | 1115.23 | 407.18 | 300.45 | 271.29 |
| 2023-09-01 | 1228.16 | 448.2 | 330.55 | 298.32 |
| 2023-10-01 | 1273.1 | 465.19 | 343.52 | 310.42 |
| 2023-11-01 | 1213.57 | 443.37 | 327.36 | 295.78 |
| 2023-12-01 | 1250.45 | 456.76 | 337.18 | 304.6 |
| 2024-01-01 | 1204.64 | 440.25 | 325.17 | 293.9 |
| 2024-02-01 | 1216.69 | 444.04 | 327.51 | 295.61 |
| 2024-03-01 | 1358.21 | 495.8 | 365.76 | 330.19 |
| 2024-04-01 | 1372.07 | 501.13 | 369.91 | 334.13 |
| 2024-05-01 | 1436.66 | 524.49 | 386.97 | 349.38 |
| 2024-06-01 | 1468.69 | 536.77 | 396.46 | 358.33 |
| 2024-07-01 | 1358.9 | 496.6 | 366.76 | 331.48 |
| 2024-08-01 | 1408.46 | 514.22 | 379.42 | 342.58 |
| 2024-09-01 | 1443.78 | 527.39 | 389.33 | 351.72 |
| 2024-10-01 | 1473.63 | 537.82 | 396.68 | 358.05 |
| 2024-11-01 | 1648.98 | 601.92 | 444.04 | 400.85 |
| 2024-12-01 | 1643.41 | 600.54 | 443.51 | 400.82 |
| 2025-01-01 | 1619.85 | 591.61 | 436.68 | 394.43 |
| 2025-02-01 | 1656.27 | 605.22 | 446.94 | 403.89 |
| 2025-03-01 | 1554.95 | 568.17 | 419.57 | 379.15 |
| 2025-04-01 | 1643.93 | 599.88 | 442.4 | 399.25 |
| 2025-05-01 | 1780.26 | 650.09 | 479.75 | 433.26 |
| 2025-06-01 | 1794.15 | 655.08 | 483.38 | 436.49 |
| 2025-07-01 | 1935.11 | 706.54 | 521.34 | 470.75 |
| 2025-08-01 | 1899.53 | 694.38 | 512.99 | 463.77 |
| 2025-09-01 | 1796.83 | 656.37 | 484.56 | 437.76 |
| 2025-10-01 | 1885.67 | 688.65 | 508.26 | 459.05 |
| 2025-11-01 | 1862.12 | 680.19 | 502.13 | 453.61 |
| 2025-12-01 | 1979.8 | 722.35 | 532.64 | 480.63 |
| 2026-01-01 | 2181.21 | 796.5 | 587.81 | 530.84 |
| 2026-02-01 | 2129.91 | 778.16 | 574.57 | 519.16 |
| 2026-03-01 | 2182.04 | 796.88 | 588.15 | 531.2 |
| 2026-04-01 | 2156.32 | 788.2 | 582.27 | 526.37 |
| 2026-05-01 | 2036.2 | 743.7 | 548.96 | 495.88 |
| 2026-06-01 | 2218.42 | 809.66 | 597.19 | 539.03 |
| 2026-07-01 | 2304.47 | 841.64 | 621.22 | 561.11 |
API access · Pro coming soon
Demo preview through July 2026 (tokens per second).
Methodology
Synthetic demo series generated to preview the data product layout.