AI data

Capability

Model, system, throughput, efficiency, context, and agentic benchmark progress.

Performance

Historical Token Throughput per GPU

Historical Token Throughput per GPU

  • H100 FP8
  • H100 FP16
  • MI300X FP8
Historical Token Throughput per GPUDemo preview through July 2026 (tokens per second).30K20K10K0Jul '23Jan '24Jul '24Jan '25Jul '25Jan '26Jul '26H100 FP8: 25.5K on Jul '26. H100 FP16: 14.4K on Jul '26. MI300X FP8: 20.8K on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026

Historical Inference Speeds

Historical Inference Speeds

  • Groq
  • Google
  • OpenAI
  • Anthropic
Historical Inference SpeedsDemo preview through July 2026 (tokens per second).3K2K1K0Jul '23Jan '24Jul '24Jan '25Jul '25Jan '26Jul '26Groq: 2.3K on Jul '26. Google: 841.6 on Jul '26. OpenAI: 621.2 on Jul '26. Anthropic: 561.1 on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026

Models

Historical Token Efficiency Across Frontier Models

Historical Token Efficiency Across Frontier Models

  • GPT-5.5
  • Claude 4.5
  • Gemini 3
Historical Token Efficiency Across Frontier ModelsDemo preview through July 2026 (benchmark points per 1M tokens).6420Jul '23Jan '24Jul '24Jan '25Jul '25Jan '26Jul '26GPT-5.5: 4.4 on Jul '26. Claude 4.5: 5 on Jul '26. Gemini 3: 4 on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026

Epoch Capabilities Index (ECI)

Epoch Capabilities Index (ECI)

  • Composite
  • Coding
  • Math
Epoch Capabilities Index (ECI)Demo preview through July 2026 (index points).3002001000Jul '23Jan '24Jul '24Jan '25Jul '25Jan '26Jul '26Composite: 175.8 on Jul '26. Coding: 195.3 on Jul '26. Math: 184.9 on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026

Frontier Model Training Compute

Frontier Model Training Compute

  • Frontier maximum
  • Frontier median
Frontier Model Training ComputeDemo preview through July 2026 (FLOPs (×10²⁶)).20151050Jul '23Jan '24Jul '24Jan '25Jul '25Jan '26Jul '26Frontier maximum: 18.4 on Jul '26. Frontier median: 5.3 on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026

Frontier Model Context Window Growth

Frontier Model Context Window Growth

  • Maximum shipped
  • Frontier median
Frontier Model Context Window GrowthDemo preview through July 2026 (million tokens).107.552.50Jul '23Jan '24Jul '24Jan '25Jul '25Jan '26Jul '26Maximum shipped: 8.4 on Jul '26. Frontier median: 2.5 on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026

Agentic and Tool-Use Benchmarks

Agentic and Tool-Use Benchmarks

  • SWE-bench Verified
  • OSWorld
  • GAIA
Agentic and Tool-Use BenchmarksDemo preview through July 2026 (percent).100%75%50%25%0%Jul '23Jan '24Jul '24Jan '25Jul '25Jan '26Jul '26SWE-bench Verified: 77.6% on Jul '26. OSWorld: 51.3% on Jul '26. GAIA: 68.8% on Jul '26
SOURCE: The LatentUPDATED: Jul 1, 2026