The Latent
EN▾
EnglishEspañol中文PortuguêsFrançaisالعربية日本語한국어
Sign Up
NEWSDATARESEARCHPODCASTNEWSLETTERPRESSPARTNER WITH US →
Data/Capability

Capability

Historical Inference Speeds

Historical Inference Speeds. Demo series compiled by The Latent research desk.

Historical Inference Speeds

  • Groq
  • Google
  • OpenAI
  • Anthropic
Historical Inference SpeedsDemo preview through July 2026 (tokens per second).3K2K1K0May '26Jun '26Jun '26Jun '26Jun '26Groq: 2.3K on Jul '26. Google: 841.6 on Jul '26. OpenAI: 621.2 on Jul '26. Anthropic: 561.1 on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026
ZOOMALLYTD12M3M1M
CSV
View data
DateGroqGoogleOpenAIAnthropic
2026-06-012218.42809.66597.19539.03
2026-07-012304.47841.64621.22561.11

API access · Pro coming soon

Demo preview through July 2026 (tokens per second).

Download CSVPro API coming soon

Methodology

Synthetic demo series generated to preview the data product layout.

Related charts

  • Historical Token Throughput per GPU
  • Historical Token Efficiency Across Frontier Models
  • Epoch Capabilities Index (ECI)

The Latent

AI industry news. A sister publication to The Block.

Editorial

  • Standards
  • Corrections
  • Commercial policy
  • Contact

Company

  • About
  • Privacy Policy
  • Terms of Service
  • Security
  • The Block