Gemini 3.7 Flash: score and benchmark evidence
Current published release · · Google
101.4 points · Rank 12 among 20 ranked models · Stability range 91.2–111.5 points.
Rank follows the point estimate; it does not establish statistically significant superiority. The scale is anchored at mean 100, SD 15 in the frozen calibration cohort, not human IQ or a percentage.
One score summarizes demonstrated capability across published reasoning settings and seven equally weighted domains. Related benchmark variants share a family budget, and influence from one evaluator is capped.
Release tli-2026-v1.0-2026-09-10-deepseek-3. Methodology and limitations for this release.
Permanent link to these exact scores and sources
Capability domains
Domain scores use calibration-cohort standard-deviation units. Unmeasured domains are shown as unavailable, not zero.
| Domain | Score (SD units) | Observed benchmarks |
|---|---|---|
| Knowledge & reasoning | 0.12 | 9 |
| Coding & software engineering | -0.10 | 11 |
| Agentic tool & computer use | -0.04 | 2 |
| Professional & real-world work | -0.09 | 14 |
| Multimodal & vision | 0.25 | 4 |
| Cybersecurity | 0.07 | 1 |
| Preference & communication | Unavailable | 0 |
Published benchmark evidence
41 results contribute to this score, from 62 collected results and 39 contributing benchmark families. Counts are not independent sample sizes.
Results, source citations, review decisions and compatible reasoning modes are stored in a versioned relational database. Each publication uses a sealed, checksum-verified export; CSV files are optional exports, not editable scoring inputs. Previous revisions remain available for audit. Collected means a numeric result exists in the database. Used means its source, exact model checkpoint and benchmark protocol have been reviewed and its benchmark has a frozen calibration supported by multiple providers. For each benchmark we select the highest published aggregate across comparable reasoning modes, not necessarily maximum effort, and count it once. More tested settings provide more chances to record a high score; this selection advantage is not corrected by the conditional interval. Developer-reported and sole/unspecified settings remain eligible and disclosed. Unresolved does not mean false or useless: conflicting metrics, unverified citations and unmatched versions stay collected until reconciled.
The score stability range is a 95% bootstrap score interval conditional on frozen calibration and comparable evidence availability. It resamples benchmark families and evaluators and adds a frozen missing-evidence correction. It excludes selection across reasoning settings, selective publication, calibration changes and new domains. It is not a 95% guarantee about true capability or where a future score will land. Sparse or conflicting evidence can widen the range.
Reporting sensitivity: ±1.3 points. Sensitivity to selectively published results. This stress range is not a confidence interval or a probability statement.
GDPval-AA v2 (Elo): 1435.34 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: Elo
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
Terminal-Bench 2.1: 85.76779%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: pass@1, AA harness
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
DeepSWE v1.1: 65.486726%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: gemini-3-7-flash; medium; mini-swe-agent
Metric: pass@1 over scored rollout attempts
Original source · Retrieved 2026-09-06
Selected the best pass@1 across published reasoning efforts within mini-swe-agent. Pass@4 is not substituted.
LMArena (Chatbot Arena) — Text: 1490 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 1490 for Gemini 3.7 Flash on LMArena (Chatbot Arena) — Text still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
AA Intelligence Index v4.1.1 (score): 56 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Held-out composite, never a scoring input
GPQA Diamond: 94.545455%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: accuracy, AA
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
AA-LCR: 80%
Not used in the score. Source category: independent. Review status: unresolved.
Configuration: Gemini 3.7 Flash (high)
Original source · Retrieved 2026-09-06
Current AA result is LCR v1.1. The inherited AA-LCR row has no reviewed version match; a new version cannot silently substantiate the older value.
Finance Agent v2 — Vals: 59.04%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: fabv2 overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
Excel Modeling Benchmark — Vals: 71.33%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: emb overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
SciCode: 59.837963%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (medium); Artificial Analysis published evaluation harness
Metric: accuracy, AA harness
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
Humanity's Last Exam (no tools): 47.868397%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: accuracy, no tools, AA
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
Legal Research Bench — Vals: 34.62%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: legal_research overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
Harvey LAB (Vals): 8.75%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: hlab overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
AA-Briefcase Overall Elo: 1116.43 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: overall Elo
Original source · Retrieved 2026-09-06
Best published result among 1 reasoning configurations of the exact AA model release; fallback configurations excluded.
MedScribe — Vals: 83.94%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: medscribe overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
SWE-bench Verified — Vals: 80.8%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: swebench overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
LegalBench — Vals: 87.26%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: legal_bench overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
TaxEval v2 — Vals: 74.73%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: tax_eval_v2 overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
Vals Index: 59.31%
Not used in the score. Source category: benchmark_org. Review status: excluded.
Configuration: gemini-3.7-flash; high effort; Vals AI index methodology
Metric: Composite score
Original source · Retrieved 2026-08-16T00:00:00.000Z
Held-out composite, never a scoring input
MedCode — Vals: 53.39%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: medcode overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
AutomationBench v1.0.6: 30.44%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 30.44 for Gemini 3.7 Flash on AutomationBench v1.0.6 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
AA-Omniscience: 26.483333 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: knowledge reliability index -100 to 100
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
MMLU Pro — Vals: 90.12%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: mmlu_pro overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
LiveBench: 78.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 78.8 for Gemini 3.7 Flash on LiveBench still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
MortgageTax — Vals: 66.65%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: mortgage_tax overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
SAGE — Vals: 49.23%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: sage overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
Code Migration †: 34.8%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: code-migration overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
Agents' Last Exam: 26.3%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 26.3 for Gemini 3.7 Flash on Agents' Last Exam still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
Terminal-Bench v3.0: 14.9%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 14.9 for Gemini 3.7 Flash on Terminal-Bench v3.0 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
LiveCodeBench: 88.65%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: lcb overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
SWE-Marathon v1.1: 22.5%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 22.5 for Gemini 3.7 Flash on SWE-Marathon v1.1 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
ProgramBench v1 (Raw Pass Rate) — Vals: 68.663%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: google/gemini-3.7-flash · reasoning_effort=high
Metric: Raw Pass Rate: mean percent of hidden behavioral tests passed per task. Not Fully Resolved (all tests pass) and not Almost Resolved (≥95% of tests pass).
Original source · Retrieved 2026-09-05
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
FrontierMath v2 Tier 4: 36.59%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 36.59 for Gemini 3.7 Flash on FrontierMath v2 Tier 4 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
CursorBench v3.2: 61.6%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash High; Cursor harness
Metric: CursorBench 3.2 score percentage
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
SWE-bench Pro: 60.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 60.4 for Gemini 3.7 Flash on SWE-bench Pro still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
CharXiv (with CI / RQ): 88.7%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 88.7 for Gemini 3.7 Flash on CharXiv (with CI / RQ) still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
MMMU-Pro: 85.491329%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: accuracy, AA
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
ARC-AGI-2: 84.6%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash; High; ARC Prize standard harness
Metric: semi-private verified score percentage
Original source · Retrieved 2026-09-06
Best reasoning variant within the verified standard-harness summary. Provider Adapter, public tasks and community agent scores are not substituted.
LVBench (with Memory): 85.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 85.4 for Gemini 3.7 Flash on LVBench (with Memory) still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
Creative Writing v3: 1725.7 native-points
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 1725.7 for Gemini 3.7 Flash on Creative Writing v3 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
MathArena — ArXivMath Jun 2026: 63.27%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 63.27 for Gemini 3.7 Flash on MathArena — ArXivMath Jun 2026 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
MathArena — BrokenArXiv Jun 2026: 11.11%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 11.11 for Gemini 3.7 Flash on MathArena — BrokenArXiv Jun 2026 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
FrontierCode v1.1 Main — Anthropic H2H: 43.6%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 43.6 for Gemini 3.7 Flash on FrontierCode v1.1 Main — Anthropic H2H still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
τ³-Banking: 35.463918%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (medium); Artificial Analysis published evaluation harness
Metric: strict task success, AA
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
CritPt: 14.285714%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: accuracy, AA official grading
Original source · Retrieved 2026-09-06
Best published result among 3 reasoning configurations of the exact AA model release; fallback configurations excluded.
Terminal-Bench 4.0: 11.2%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash; high; mini-SWE-agent
Metric: resolution rate, v4.0.0 66 tasks
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
GDP.pdf: 23.8%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (High reasoning); Surge original evaluation
Metric: all-pass percentage, original Surge GDP.pdf
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
ProofBench v1.1 — Vals: 58%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: proof_bench overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
Vibe Code Bench v1.1 — Vals: 70.39%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: vibe-code overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
MineBench: 1867 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Unresolved Pro/base model identities in source catalog; exclude until matched.
ARC-AGI-1: 95.5%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash; High; ARC Prize standard harness
Metric: semi-private verified score percentage
Original source · Retrieved 2026-09-06
Best reasoning variant within the verified standard-harness summary. Provider Adapter, public tasks and community agent scores are not substituted.
Harvey LAB-AA: 90.66%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 90.66 for Gemini 3.7 Flash on Harvey LAB-AA still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
EnterpriseOps-Gym-AA: 50.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 50.4 for Gemini 3.7 Flash on EnterpriseOps-Gym-AA still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
MLCR-AA (Medical Long Context Reasoning): 15%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: overall accuracy, AA
Original source · Retrieved 2026-09-06
Best published result among 1 reasoning configurations of the exact AA model release; fallback configurations excluded.
AA-AnalystAgent: 60%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash (high); Artificial Analysis published evaluation harness
Metric: accuracy, AA
Original source · Retrieved 2026-09-06
Best published result among 1 reasoning configurations of the exact AA model release; fallback configurations excluded.
CWE-bench: 44%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Gemini 3.7 Flash; high reasoning; Antigravity
Metric: v0 Sept 1 deterministic pass@1, 100 tasks; exploit blocked and existing tests pass
Original source · Retrieved 2026-09-06
Published high effort matches this model configuration. Other models pinned to max/xhigh are not approved from this high-only board.
Mystery Game Puzzles v1.0.4 — Epoch: 37%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 37 for Gemini 3.7 Flash on Mystery Game Puzzles v1.0.4 — Epoch still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
Tax Agent Bench v1 — Vals: 57.66%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: google_gemini-3.7-flash; Vals high effort
Metric: tax_agent_bench overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
RuneBench (30m, mean ln(1 + XP/min)): 5.963375 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: gemini37flash
Metric: Arithmetic mean of ln(1 + peakXpRate) over all 16 skills, exactly as the owner’s Heatmap.js default ranking. Data rates are already normalized; do not divide by 200 again.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
VoxelBench (text-to-voxel, Glicko-2): 1854 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: Gemini 3.7 Flash
Metric: Glicko-2 rating from the text-to-voxel board; not win percentage, deviation, image-input mode or MineBench Elo.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Roboflow Vision Evals (six-task mean, high tier): 86.216667%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: Require a complete six-task high-tier panel, the highest published benchmark tier. Retain high-tier scores even when lower than low-tier. Do not substitute the best of three repetitions: use the published mean. Each panel enters the fit once; do not also fit its components.
Metric: Arithmetic mean of six published high-tier task means; derived by The Latent, not Roboflow’s official low-tier overall score.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Code Arena WebDev (overall): 1587 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: gemini-3.7-flash-high
Metric: Published overall WebDev preference rating, not task success percentage or Arena Text score.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Cite this model record
The Latent. “Gemini 3.7 Flash: score and benchmark evidence.” 2026-09-10. Release tli-2026-v1.0-2026-09-10-deepseek-3.
Download release data and definitions (JSON) · Data usage terms