Fable 5.1: score and benchmark evidence
Historical release · · Anthropic
131.0 points · Rank 2 among 19 ranked models · Stability range 101.4–157.5 points.
Rank follows the point estimate; it does not establish statistically significant superiority. The scale is anchored at mean 100, SD 15 in the frozen calibration cohort, not human IQ or a percentage.
One capability score combines evidence across seven equally weighted domains. Related benchmark variants share a family budget, and influence from one evaluator is capped.
Release tli-2026-v5.0-2026-09-06. Methodology and limitations for this release.
This page preserves historical evidence. See the current model record.
Capability domains
Domain scores use calibration-cohort standard-deviation units. Unmeasured domains are shown as unavailable, not zero.
| Domain | Score (SD units) | Observed benchmarks |
|---|---|---|
| Knowledge & reasoning | 1.09 | 2 |
| Coding & software engineering | 1.06 | 4 |
| Agentic tool & computer use | 0.80 | 1 |
| Professional & real-world work | 0.86 | 10 |
| Multimodal & vision | 0.62 | 3 |
| Cybersecurity | Unavailable | 0 |
| Preference & communication | Unavailable | 0 |
Published benchmark evidence
20 results contribute to this score, from 61 collected results and 20 contributing benchmark families. Counts are not independent sample sizes.
Only results with a matched source record, metric and documented configuration contribute. Developer-reported results are eligible when their configuration is clear. Unresolved records remain in the database with their exclusion reason. Archived reviews and live source checks are labelled separately.
The interval reflects limited evidence, missing domains, correlated benchmark families and frozen calibration uncertainty under the scoring assumptions. It is not a promise that future scores will fall inside it 95% of the time. New conflicting evidence can widen it.
Reporting sensitivity: ±10.5 points. Sensitivity to selectively published results. This stress range is not a confidence interval or a probability statement.
GDPval-AA v2 (Elo): 1853 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Terminal-Bench 2.1: 91.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
DeepSWE v1.1: 67.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
LMArena (Chatbot Arena) — Text: 1504 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA Intelligence Index v4.1.1 (score): 66 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Held-out composite, never a scoring input
GPQA Diamond: 93.74%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA-LCR: 80%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Finance Agent v2 — Vals: 58.88%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: Finance Agent (v2) overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Excel Modeling Benchmark — Vals: 76.67%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: EMB overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
SciCode: 62%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Humanity's Last Exam (no tools): 60.9%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Legal Research Bench — Vals: 55.29%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: Legal Research Bench overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Harvey LAB (Vals): 6.67%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: Harvey's Legal Agent Benchmark overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
AA-Briefcase Overall Elo: 1694 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MedScribe — Vals: 91.29%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: MedScribe overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
LegalBench — Vals: 88.51%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: LegalBench overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
TaxEval v2 — Vals: 75.96%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: TaxEval v2 overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Public Benefits Bench — Vals: 74.9%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: Public Benefits Bench v1.1 overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
MedCode — Vals: 53.51%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: MedCode overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
AA-Omniscience: 43 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MMLU Pro — Vals: 92.38%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: MMLU Pro overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
LiveBench: 83.41%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MortgageTax — Vals: 70.79%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: MortgageTax overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
SAGE — Vals: 48.53%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: SAGE overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Toolathlon-Verified: 77.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
LiveCodeBench: 90.52%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: LiveCodeBench overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Humanity's Last Exam w/ tools: 65%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ProgramBench v1 (Raw Pass Rate) — Vals: 82.688%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: anthropic/claude-fable-5-1 · compute=max
Metric: Raw Pass Rate: mean percent of hidden behavioral tests passed per task. Not Fully Resolved (all tests pass) and not Almost Resolved (≥95% of tests pass).
Original source · Retrieved 2026-09-05
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
FrontierSWE: 57%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierMath v2 Tier 4: 87.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CursorBench v3.2: 73.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
APEX-Agents Mean Criteria Passed: 62%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
SWE-bench Pro: 81.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
APEX-SWE (Pass@1, Terminus-2): 63.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MMMU-Pro: 90.64%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ARC-AGI-2: 90%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
OSWorld 2.0 — Anthropic H2H: 77.9%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierCode v1.1 Extended: 63.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MathArena — ArXivMath Jun 2026: 91.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
OfficeQA Pro †: 69%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierCode v1.1 Main — Anthropic H2H: 50.9%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AutomationBench — Anthropic H2H: 31.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Harvey Legal Agent Benchmark — held-out: 16.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
τ³-Banking: 47.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CritPt: 29.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Terminal-Bench 4.0: 57.9%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ProofBench v1.1 — Vals: 100%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: ProofBench v1.1 overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Vibe Code Bench v1.1 — Vals: 90.26%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: anthropic_claude-fable-5-1; Vals max effort
Metric: Vibe Code Bench v1.1 overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
MineBench: 2050 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Unresolved Pro/base model identities in source catalog; exclude until matched.
ARC-AGI-1: 97.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
BenchCAD (Vision2Code subset): 84.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Terminal-Bench Science 0.1: 52.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Source selects the maximum score across efforts; exact highest-effort result is not established.
Harvey LAB-AA: 93.02%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Vending-Bench 2: 5421.56 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Internal Database Migration Tasks — OpenAI: 57.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Source selects the maximum score across efforts; exact highest-effort result is not established.
Mystery Game Puzzles v1.0.4 — Epoch: 58%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierMath Erdos (68 conjectures) — Epoch: 0 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
RuneBench (30m, mean ln(1 + XP/min)): 6.143277 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: fable51-xhigh
Metric: Arithmetic mean of ln(1 + peakXpRate) over all 16 skills, exactly as the owner’s Heatmap.js default ranking. Data rates are already normalized; do not divide by 200 again.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
VoxelBench (text-to-voxel, Glicko-2): 2245 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: Claude Fable 5.1
Metric: Glicko-2 rating from the text-to-voxel board; not win percentage, deviation, image-input mode or MineBench Elo.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Roboflow Vision Evals (six-task mean, high tier): 82.516667%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: Require a complete six-task high-tier panel, the highest published benchmark tier. Retain high-tier scores even when lower than low-tier. Do not substitute the best of three repetitions: use the published mean. Each panel enters the fit once; do not also fit its components.
Metric: Arithmetic mean of six published high-tier task means; derived by The Latent, not Roboflow’s official low-tier overall score.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Code Arena WebDev (overall): 1762 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: claude-fable-5.1-max
Metric: Published overall WebDev preference rating, not task success percentage or Arena Text score.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Cite this model record
The Latent. “Fable 5.1: score and benchmark evidence.” 2026-09-06. Release tli-2026-v5.0-2026-09-06.
Download release data and definitions (JSON) · Data usage terms
Related reporting
These dated stories provide reporting context; they may describe an earlier release.