DeepSeek V4.1-Flash: score and benchmark evidence
Historical release · · DeepSeek
102.9 points · Rank 20 among 36 ranked models · Stability range 95.2–110.5 points.
Rank follows the point estimate; it does not establish statistically significant superiority. The scale is anchored at mean 100, SD 15 in the frozen calibration cohort, not human IQ or a percentage.
One score summarizes demonstrated capability across published reasoning settings and seven equally weighted domains. Related benchmark variants share a family budget, and influence from one evaluator is capped.
Release tli-2026-v1.0-2026-10-21-refresh-34. Methodology and limitations for this release.
This page preserves historical evidence. See the current model record.
Capability domains
Domain scores use calibration-cohort standard-deviation units. Unmeasured domains are shown as unavailable, not zero.
| Domain | Score (SD units) | Observed benchmarks |
|---|---|---|
| Knowledge & reasoning | -0.37 | 7 |
| Coding & software engineering | 0.30 | 8 |
| Agentic tool & computer use | 0.46 | 4 |
| Professional & real-world work | -0.19 | 8 |
| Multimodal & vision | -0.12 | 2 |
| Cybersecurity | 0.39 | 1 |
| Preference & communication | Unavailable | 0 |
Published benchmark evidence
30 results contribute to this score, from 41 collected results and 26 contributing benchmark families. Counts are not independent sample sizes.
Results, source citations, review decisions and compatible reasoning modes are stored in a versioned relational database. Each publication uses a sealed, checksum-verified export; CSV files are optional exports, not editable scoring inputs. Previous revisions remain available for audit. Collected means a numeric result exists in the database. Used means its source, exact model checkpoint and benchmark protocol have been reviewed and its benchmark has a frozen calibration supported by multiple providers. For each benchmark we select the highest published aggregate across comparable reasoning modes, not necessarily maximum effort, and count it once. More tested settings provide more chances to record a high score; this selection advantage is not corrected by the conditional interval. Developer-reported and sole/unspecified settings remain eligible and disclosed. Unresolved does not mean false or useless: conflicting metrics, unverified citations and unmatched versions stay collected until reconciled.
The score stability range is a 95% bootstrap score interval conditional on frozen calibration and comparable evidence availability. It resamples benchmark families and evaluators and adds a frozen missing-evidence correction. It excludes selection across reasoning settings, selective publication, calibration changes and new domains. It is not a 95% guarantee about true capability or where a future score will land. Sparse or conflicting evidence can widen the range.
Reporting sensitivity: ±4.7 points. Sensitivity to selectively published results. This stress range is not a confidence interval or a probability statement.
GPQA Diamond: 90.9%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
Humanity's Last Exam (no tools): 36.8%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Full HLE 36.8; the separately reported 39.1 is text-only and is not substituted.
HLE text-only — DeepSeek V4.1 release: 39.1%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
Codeforces Rating — DeepSeek V4.1 release: 3471 native-points
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: rating
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
MathArena Apex: 65.6%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
Terminal-Bench 2.1: 90.6%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
Terminal-Bench v3.0: 30%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
Terminal-Bench 4.0: 31.2%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
DeepSWE v1.1: 74.2%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
ProgramBench — DeepSeek V4.1 release: 20.3%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
NL2Repo: 65.4%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
CyberGym: 88.1%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
SEC-Bench Pro — DeepSeek V4.1 release: 62.8%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
ExploitGym: 15.3%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
Humanity's Last Exam w/ tools: 63.9%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
Automation-Bench — DeepSeek V4.1 release: 54.8%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
Agents' Last Exam: 31.8%
Contributes to the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim.
Chartography (w/tools): 78.9%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
BabyVision (w/tools): 89.6%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
ZeroBench-main (w/tools): 49%
Not used in the score. Developer-reported. Review status: reviewed-developer.
Configuration: DeepSeek V4.1-Flash, September 10 release; sole published setting (effort undisclosed)
Metric: published benchmark score (%)
Original source · Retrieved 2026-09-10
Developer-reported release-table aggregate, corroborated against the supplied screenshot. Effort, harness, retry budget and fallback accounting are undisclosed; no maximum-effort claim. Retained as a separate protocol; does not contribute to the current frozen score.
AA Intelligence Index v4.3.2 (score): 39.456167 native-points
Not used in the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published native-points
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
AA-Briefcase v1.1 (Elo): 1419.38 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published native-points
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
AA-LCR v1.1: 84%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
AA-Omniscience: -5.3 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published native-points
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
AutomationBench-AA: 68.890978%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
CritPt: 14.285714%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
GDP.pdf — AA harness: 12.8%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
GDPval-AA v2.1 (Elo): 1600 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published native-points
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
HLE text-only — AA harness: 39.249305%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
MMMU-Pro: 76.99422%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
SciCode: 51.851852%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
Terminal-Bench 4.0 — AA harness: 26.767677%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Artificial Analysis independent evaluation, 2026-10-21; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Daily evaluator refresh; the evaluator published this benchmark after admission.
BioMysteryBench v1 — Vals: 67.78%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI BioMysteryBench harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 67.78 ± 1.11, rank 16/27. Vals notes some benchmarks may use a different provider or parameters.
LegalBench — Vals: 83.28%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI LegalBench harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 83.28 ± 0.46, rank 56/151. Vals notes some benchmarks may use a different provider or parameters.
Legal Research Bench — Vals: 41.35%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI Legal Research Bench harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 41.35 ± 3.42, rank 26/82. Vals notes some benchmarks may use a different provider or parameters.
MedCode — Vals: 41.17%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI MedCode harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 41.17 ± 2.04, rank 57/107. Vals notes some benchmarks may use a different provider or parameters.
MedScribe — Vals: 85.5%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI MedScribe harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 85.5 ± 1.92, rank 27/109. Vals notes some benchmarks may use a different provider or parameters.
ProofBench v1.1 — Vals: 54%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI ProofBench v1.1 harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 54.0 ± 5.01, rank 28/50. Vals notes some benchmarks may use a different provider or parameters.
Public Benefits Bench — Vals: 64.28%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI Public Benefits Bench v1.1 harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 64.28 ± 1.25, rank 23/50. Vals notes some benchmarks may use a different provider or parameters.
SAGE — Vals: 47.88%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI SAGE harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 47.88 ± 3.44, rank 29/91. Vals notes some benchmarks may use a different provider or parameters.
Vibe Code Bench v1.1 — Vals: 84.74%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: DeepSeek V4.1-Flash (max); Vals AI Vibe Code Bench v1.1 harness; provider DeepSeek; fallback not reported
Metric: published percent
Original source · Retrieved 2026-10-21
Vals AI model page, headline accuracy 84.74 ± 2.89, rank 17/116. Vals notes some benchmarks may use a different provider or parameters.
Cite this model record
The Latent. “DeepSeek V4.1-Flash: score and benchmark evidence.” 2026-10-21. Release tli-2026-v1.0-2026-10-21-refresh-34.
Download release data and definitions (JSON) · Data usage terms
Related reporting
These dated stories provide reporting context; they may describe an earlier release.