DeepSeek V4 Pro: score and benchmark evidence
Historical release · · DeepSeek
88.8 points · Rank 15 among 19 ranked models · Stability range 81.5–95 points.
Rank follows the point estimate; it does not establish statistically significant superiority. The scale is anchored at mean 100, SD 15 in the frozen calibration cohort, not human IQ or a percentage.
One capability score combines evidence across seven equally weighted domains. Related benchmark variants share a family budget, and influence from one evaluator is capped.
Release tli-2026-v5.1-2026-09-06. Methodology and limitations for this release.
This page preserves historical evidence. See the current model record.
Capability domains
Domain scores use calibration-cohort standard-deviation units. Unmeasured domains are shown as unavailable, not zero.
| Domain | Score (SD units) | Observed benchmarks |
|---|---|---|
| Knowledge & reasoning | -0.39 | 6 |
| Coding & software engineering | -0.09 | 6 |
| Agentic tool & computer use | -0.34 | 1 |
| Professional & real-world work | -0.55 | 10 |
| Multimodal & vision | Unavailable | 0 |
| Cybersecurity | Unavailable | 0 |
| Preference & communication | Unavailable | 0 |
Published benchmark evidence
23 results contribute to this score, from 56 collected results and 23 contributing benchmark families. Counts are not independent sample sizes.
Only results with a matched source record, metric and documented configuration contribute. Developer-reported results are eligible when their configuration is clear. Unresolved records remain in the database with their exclusion reason. Archived reviews and live source checks are labelled separately.
The bar estimates score stability under the scoring assumptions: a fixed calibration and comparable benchmark availability. It resamples benchmark families and evaluators while keeping each domain’s evidence strength fixed, then adds a frozen correction learned from missing-evidence tests. Benchmark count and domain coverage both affect that correction. It does not add a second full capability-posterior draw or uncertainty from changing the reference calibration. It is not a guarantee under selective publication, new benchmark domains or future model releases.
Reporting sensitivity: ±7.4 points. Sensitivity to selectively published results. This stress range is not a confidence interval or a probability statement.
GDPval-AA v2 (Elo): 1590 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Terminal-Bench 2.1: 78.7%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4 Pro 0813 (Reasoning, Max Effort); AA published evaluation harness
Metric: pass@1 accuracy, AA harness
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
DeepSWE v1.1: 62.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
LMArena (Chatbot Arena) — Text: 1465 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA Intelligence Index v4.1.1 (score): 53 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Held-out composite, never a scoring input
GPQA Diamond: 92.8%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4 Pro 0813 (Reasoning, Max Effort); AA published evaluation harness
Metric: accuracy, AA
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
AA-LCR: 75.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Finance Agent v2 — Vals: 50.4%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: Finance Agent (v2) overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Excel Modeling Benchmark — Vals: 52.8%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: EMB overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
SciCode: 49.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Humanity's Last Exam (no tools): 41%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4 Pro 0813 (Reasoning, Max Effort); AA published evaluation harness
Metric: accuracy, no tools, AA
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
Legal Research Bench — Vals: 40.87%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: Legal Research Bench overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Harvey LAB (Vals): 7.5%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: Harvey's Legal Agent Benchmark overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
AA-Briefcase Overall Elo: 1286 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MedScribe — Vals: 80.17%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: MedScribe overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
SWE-bench Verified — Vals: 96.4%
Contributes to the score. Source category: benchmark_org. Review status: reviewed-archive.
Configuration: deepseek-v4-pro; max effort; Vals AI mini-SWE-agent bash harness
Metric: Resolved issue rate
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
LegalBench — Vals: 82.36%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: LegalBench overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
TaxEval v2 — Vals: 73.06%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: TaxEval v2 overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
KingBench 3: 76.25%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Vals Index: 66.25%
Not used in the score. Source category: benchmark_org. Review status: excluded.
Configuration: deepseek-v4-pro; max effort; Vals AI index methodology
Metric: Composite score
Original source · Retrieved 2026-08-16T00:00:00.000Z
Held-out composite, never a scoring input
Public Benefits Bench — Vals: 62.92%
Contributes to the score. Source category: benchmark_org. Review status: reviewed-archive.
Configuration: deepseek-v4-pro; max effort; Vals AI public-benefits evaluation
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
MedCode — Vals: 42.47%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: MedCode overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
AutomationBench v1.0.6: 43.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
AA-Omniscience: 0.8 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4 Pro 0813 (Reasoning, Max Effort); AA published evaluation harness
Metric: AA Omniscience index -100 to 100
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
MMLU Pro — Vals: 86.97%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: MMLU Pro overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
LiveBench: 77.44%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CorpFin v2 — Vals: 65.42%
Contributes to the score. Source category: benchmark_org. Review status: reviewed-archive.
Configuration: deepseek-v4-pro; max effort; Vals AI CorpFin v2 evaluation with Sonnet 4.5 judge
Metric: Accuracy
Original source · Retrieved 2026-08-16T00:00:00.000Z
Exact-value match to an existing verified, comparable, pinned-configuration observation. Archived review retained; not asserted newly independently replicated.
Code Migration †: 41.54%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: Code Migration overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Toolathlon-Verified: 74.1%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Agents' Last Exam: 25.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
LiveCodeBench: 87.53%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: LiveCodeBench overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
CyberGym: 83.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Humanity's Last Exam w/ tools: 60%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
SWE-Marathon v1.1: 10.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ProgramBench v1 (Raw Pass Rate) — Vals: 70.103%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: deepseek/deepseek-v4-pro-0813 · reasoning_effort=max
Metric: Raw Pass Rate: mean percent of hidden behavioral tests passed per task. Not Fully Resolved (all tests pass) and not Almost Resolved (≥95% of tests pass).
Original source · Retrieved 2026-09-05
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
FrontierMath v2 Tier 4: 26.83%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
SWE-bench Pro: 55.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
BrowseComp: 83.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
ARC-AGI-2: 61.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
SimpleQA: 57.9%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MCP Atlas †: 73.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
NL2Repo: 61.1%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
CoWorkBench: 66.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
τ²-Bench Telecom: 96.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
FrontierCode v1.1 Main — Anthropic H2H: 17.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
EQ-Bench 3: 1570.2 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
τ³-Banking: 39.6%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4 Pro 0813 (Reasoning, Max Effort); AA published evaluation harness
Metric: strict task success, AA
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
CritPt: 18%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4 Pro 0813 (Reasoning, Max Effort); AA published evaluation harness
Metric: accuracy, AA official grading
Original source · Retrieved 2026-09-06
Current first-party evaluator data matches the recorded score at its published rounding. Exact pinned configuration selected; later value changes are not silently substituted.
ProofBench v1.1 — Vals: 50%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: ProofBench v1.1 overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
Vibe Code Bench v1.1 — Vals: 82.3%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: deepseek_deepseek-v4-pro-0813; Vals max effort
Metric: Vibe Code Bench v1.1 overall percentage; Vals benchmark-specific harness
Original source · Retrieved 2026-09-06
Exact model and benchmark row; current source value agrees at sheet rounding. Uses published default parameters; source warns individual benchmarks may override them. Known mismatched rows/harnesses are not imported.
ARC-AGI-1: 90%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
EnterpriseOps-Gym-AA: 49.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
MLCR-AA (Medical Long Context Reasoning): 17.78%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
IFBench: 76.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Mystery Game Puzzles v1.0.4 — Epoch: 43%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Tax Agent Bench v1 — Vals: 58.663%
Not used in the score. Source category not recorded. Review status: unresolved.
Inherited cell lacks a matched, reviewed source/configuration record.
Cite this model record
The Latent. “DeepSeek V4 Pro: score and benchmark evidence.” 2026-09-06. Release tli-2026-v5.1-2026-09-06.
Download release data and definitions (JSON) · Data usage terms
Related reporting
These dated stories provide reporting context; they may describe an earlier release.