Kimi K3: score and benchmark evidence
Historical release · · Moonshot AI
105.8 points · Rank 6 among 19 ranked models · Stability range 78.6–132 points.
Rank follows the point estimate; it does not establish statistically significant superiority. The scale is anchored at mean 100, SD 15 in the frozen calibration cohort, not human IQ or a percentage.
One capability score combines evidence across seven equally weighted domains. Related benchmark variants share a family budget, and influence from one evaluator is capped.
Release tli-2026-v5.0-2026-09-06. Methodology and limitations for this release.
This page preserves historical evidence. See the current model record.
Capability domains
Domain scores use calibration-cohort standard-deviation units. Unmeasured domains are shown as unavailable, not zero.
| Domain | Score (SD units) | Observed benchmarks |
|---|---|---|
| Knowledge & reasoning | 0.10 | 6 |
| Coding & software engineering | 0.18 | 3 |
| Agentic tool & computer use | -0.10 | 3 |
| Professional & real-world work | 0.12 | 10 |
| Multimodal & vision | 0.27 | 2 |
| Cybersecurity | Unavailable | 0 |
| Preference & communication | 0.37 | 1 |
Published benchmark evidence
25 results contribute to this score, from 93 collected results and 23 contributing benchmark families. Counts are not independent sample sizes.
Only results with a matched source record, metric and documented configuration contribute. Developer-reported results are eligible when their configuration is clear. Unresolved records remain in the database with their exclusion reason. Archived reviews and live source checks are labelled separately.
The interval reflects limited evidence, missing domains, correlated benchmark families and frozen calibration uncertainty under the scoring assumptions. It is not a promise that future scores will fall inside it 95% of the time. New conflicting evidence can widen it.
Reporting sensitivity: ±7.4 points. Sensitivity to selectively published results. This stress range is not a confidence interval or a probability statement.
GDPval-AA v2 (Elo): 1682 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Terminal-Bench 2.1: 88.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
DeepSWE v1.1: 69%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
LMArena (Chatbot Arena) — Text: 1489 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA Intelligence Index v4.1.1 (score): 60 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Held-out composite, never a scoring input
GPQA Diamond: 93.5%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Kimi K3 (max); AA published evaluation harness
Metric: accuracy, AA
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
AA-LCR: 74.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Finance Agent v2 — Vals: 54.4%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI Finance Agent v2 harness
Metric: Task success
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
Excel Modeling Benchmark — Vals: 66.4%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI Excel Modeling overall evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
SciCode: 58.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Humanity's Last Exam (no tools): 44.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Legal Research Bench — Vals: 44.23%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI Legal Research overall harness
Metric: Task success
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
Harvey LAB (Vals): 10.83%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA-Briefcase Overall Elo: 1541 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MedScribe — Vals: 87.96%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI health evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
SWE-bench Verified — Vals: 93.4%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI mini-SWE-agent bash harness
Metric: Resolved issue rate
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
LegalBench — Vals: 86.02%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI LegalBench evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
TaxEval v2 — Vals: 75.72%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI max-compute evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
KingBench 3: 77.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Vals Index: 74.7%
Not used in the score. Source category: independent. Review status: excluded.
Configuration: kimi-k3; max effort; Vals AI index methodology
Metric: Composite score
Original source · Retrieved 2026-08-16T00:00:00.000Z
Held-out composite, never a scoring input
Public Benefits Bench — Vals: 68.27%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI public-benefits evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
MedCode — Vals: 48.88%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI health evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
AutomationBench v1.0.6: 46.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA-Omniscience: 18.42 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MMLU Pro — Vals: 87.97%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI five-shot MMLU-Pro harness
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
LiveBench: 79.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CorpFin v2 — Vals: 71.56%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI CorpFin v2 evaluation with Sonnet 4.5 judge
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
MortgageTax — Vals: 66.34%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI max-compute evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
SAGE — Vals: 54.26%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Vals AI max-compute evaluation
Metric: Score
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
Code Migration †: 16.1%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Toolathlon-Verified: 76.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Agents' Last Exam: 28.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Terminal-Bench v3.0: 17.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
LiveCodeBench: 87.19%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CyberGym: 80%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Humanity's Last Exam w/ tools: 59.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Design Arena (Elo): 1453 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Design Arena 2026-08-11 rating snapshot
Metric: Elo rating
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
Vals Multimodal Index: 73.42%
Not used in the score. Source category: independent. Review status: excluded.
Configuration: kimi-k3; max effort; Vals AI multimodal index methodology
Metric: Composite score
Original source · Retrieved 2026-08-16T00:00:00.000Z
Held-out composite, never a scoring input
SWE-Marathon v1.1: 48.1%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ProgramBench v1 (Raw Pass Rate) — Vals: 62.768%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi/kimi-k3 · Vals published row (effort not stated)
Metric: Raw Pass Rate: mean percent of hidden behavioral tests passed per task. Not Fully Resolved (all tests pass) and not Almost Resolved (≥95% of tests pass).
Original source · Retrieved 2026-09-05
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
FrontierSWE: 81.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierMath v2 Tier 4: 39.02%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CursorBench v3.2: 60.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
APEX-Agents Mean Criteria Passed: 55.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CharXiv (with CI / RQ): 91.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
APEX-SWE (Pass@1, Terminus-2): 48%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
BrowseComp: 91.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MMMU-Pro: 81.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ARC-AGI-2: 60.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
OSWorld 2.0 — Anthropic H2H: 58.3%
Contributes to the score. Source category: third_party. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; Anthropic Opus 5 published head-to-head setup
Metric: Task success
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
ExploitBench: 32.2%
Not used in the score. Source category not recorded. Review status: excluded.
Inherited comparator metric/scaffold equivalence to Astra Cap Percent is not established; the source flags possible contamination. Excluded pending protocol audit.
PostTrainBench: 32%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierCode v1.1 Extended: 58.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
JobBench: 54.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
BabyVision (with CI): 85.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
PerceptionBench: 58.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
OSWorld-Verified: 84.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Creative Writing v3: 2070.8 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MathArena — ArXivMath Jun 2026: 72.11%
Contributes to the score. Source category: benchmark_org. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; MathArena June 2026 competition harness
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
MathArena — BrokenArXiv Jun 2026: 51.85%
Contributes to the score. Source category: benchmark_org. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; MathArena June 2026 competition harness
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
AIIQ Composite IQ: 122 native-points
Not used in the score. Source category: independent. Review status: excluded.
Configuration: kimi-k3; max effort; AIIQ composite snapshot
Metric: Composite IQ
Original source · Retrieved 2026-08-16T00:00:00.000Z
Held-out composite, never a scoring input
MCP Atlas †: 84.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
OfficeQA Pro †: 63.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
EQ-Bench 4: 1339 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
NL2Repo: 58%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
τ²-Bench Telecom: 80.63%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierCode v1.1 Main — Anthropic H2H: 44.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MathArena — ArXivMath May 2026: 61.67%
Contributes to the score. Source category: benchmark_org. Review status: reviewed-archive.
Configuration: kimi-k3; max effort; MathArena May 2026 competition harness
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
τ³-Banking: 46%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Kimi K3 (max); AA published evaluation harness
Metric: strict task success, AA
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
CritPt: 23.4%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Kimi K3 (max); AA published evaluation harness
Metric: accuracy, AA official grading
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
GDP.pdf: 19%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ProofBench v1.1 — Vals: 87%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Vibe Code Bench v1.1 — Vals: 84.96%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MineBench: 1812 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Unresolved Pro/base model identities in source catalog; exclude until matched.
ARC-AGI-1: 94.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Harvey LAB-AA: 94.64%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
EnterpriseOps-Gym-AA: 45.33%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MLCR-AA (Medical Long Context Reasoning): 38.33%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA-AnalystAgent: 38.75%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ITBench-AA: 47.69%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
DeepSearchQA: 95%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Vending-Bench 2: 5165.04 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
IFBench: 74.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CWE-bench: 22.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ZeroBench: 23%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MathVision (with CI): 97.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
OmniDocBench 1.5: 91.1%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Mystery Game Puzzles v1.0.4 — Epoch: 26%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
BioMysteryBench v1 — Vals: 71.481%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Tax Agent Bench v1 — Vals: 68.672%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
RuneBench (30m, mean ln(1 + XP/min)): 3.753577 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi3
Metric: Arithmetic mean of ln(1 + peakXpRate) over all 16 skills, exactly as the owner’s Heatmap.js default ranking. Data rates are already normalized; do not divide by 200 again.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
VoxelBench (text-to-voxel, Glicko-2): 1932 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: Kimi K3 (Max)
Metric: Glicko-2 rating from the text-to-voxel board; not win percentage, deviation, image-input mode or MineBench Elo.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Code Arena WebDev (overall): 1674 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: kimi-k3-max
Metric: Published overall WebDev preference rating, not task success percentage or Arena Text score.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Cite this model record
The Latent. “Kimi K3: score and benchmark evidence.” 2026-09-06. Release tli-2026-v5.0-2026-09-06.
Download release data and definitions (JSON) · Data usage terms
Related reporting
These dated stories provide reporting context; they may describe an earlier release.