Muse Spark 1.3: score and benchmark evidence
Historical release · · Meta
114.2 points · Rank 5 among 19 ranked models · Stability range 102.3–125.8 points.
Rank follows the point estimate; it does not establish statistically significant superiority. The scale is anchored at mean 100, SD 15 in the frozen calibration cohort, not human IQ or a percentage.
One capability score combines evidence across seven equally weighted domains. Related benchmark variants share a family budget, and influence from one evaluator is capped.
Release tli-2026-v1.0-2026-09-06-db. Methodology and limitations for this release.
This page preserves historical evidence. See the current model record.
Capability domains
Domain scores use calibration-cohort standard-deviation units. Unmeasured domains are shown as unavailable, not zero.
| Domain | Score (SD units) | Observed benchmarks |
|---|---|---|
| Knowledge & reasoning | 0.58 | 4 |
| Coding & software engineering | 0.46 | 3 |
| Agentic tool & computer use | 0.34 | 2 |
| Professional & real-world work | 0.53 | 2 |
| Multimodal & vision | 0.12 | 2 |
| Cybersecurity | Unavailable | 0 |
| Preference & communication | Unavailable | 0 |
Published benchmark evidence
13 results contribute to this score, from 23 collected results and 13 contributing benchmark families. Counts are not independent sample sizes.
Results, source citations, review decisions and compatible reasoning modes are stored in a versioned relational database. Each publication uses a sealed, checksum-verified export; CSV files are optional exports, not editable scoring inputs. Previous revisions remain available for audit. Collected means a numeric result exists in the database. Used means its source, exact model checkpoint and benchmark protocol have been reviewed and its benchmark has a frozen calibration supported by multiple providers. For each benchmark we select the highest published aggregate across comparable reasoning modes, not necessarily maximum effort, and count it once. More tested settings provide more chances to record a high score; this selection advantage is not corrected by the conditional interval. Developer-reported and sole/unspecified settings remain eligible and disclosed. Unresolved does not mean false or useless: conflicting metrics, unverified citations and unmatched versions stay collected until reconciled.
The bar estimates score stability under the scoring assumptions: a fixed calibration and comparable benchmark availability. It resamples benchmark families and evaluators while keeping each domain’s evidence strength fixed, then adds a frozen correction learned from missing-evidence tests. Benchmark count and domain coverage both affect that correction. It does not add a second full capability-posterior draw or uncertainty from changing the reference calibration. It is not a guarantee under selective publication, new benchmark domains or future model releases.
Reporting sensitivity: ±18.2 points. Sensitivity to selectively published results. This stress range is not a confidence interval or a probability statement.
GDPval-AA v2 (Elo): 1719.65 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (max); Artificial Analysis published evaluation harness
Metric: Elo
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
Terminal-Bench 2.1: 85.76779%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (max); Artificial Analysis published evaluation harness
Metric: pass@1, AA harness
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
DeepSWE v1.1: 75.4%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 75.4 for Muse Spark 1.3 on DeepSWE v1.1 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
AA Intelligence Index v4.1.1 (score): 61 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Held-out composite, never a scoring input
GPQA Diamond: 94.141414%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (xhigh); Artificial Analysis published evaluation harness
Metric: accuracy, AA
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
AA-LCR: 79%
Not used in the score. Source category: independent. Review status: unresolved.
Configuration: Muse Spark 1.3 (xhigh)
Original source · Retrieved 2026-09-06
Current AA result is LCR v1.1. The inherited AA-LCR row has no reviewed version match; a new version cannot silently substantiate the older value.
SciCode: 59.722222%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (xhigh); Artificial Analysis published evaluation harness
Metric: accuracy, AA harness
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
Humanity's Last Exam (no tools): 49.073216%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (max); Artificial Analysis published evaluation harness
Metric: accuracy, no tools, AA
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
AutomationBench v1.0.6: 43.8%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 43.8 for Muse Spark 1.3 on AutomationBench v1.0.6 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
AA-Omniscience: 24.933333 native-points
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (max); Artificial Analysis published evaluation harness
Metric: knowledge reliability index -100 to 100
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
LiveBench: 81.59%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 81.59 for Muse Spark 1.3 on LiveBench still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
MMMU-Pro: 82.023121%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (xhigh); Artificial Analysis published evaluation harness
Metric: accuracy, AA
Original source · Retrieved 2026-09-06
Best published result among 1 reasoning configurations of the exact AA model release; fallback configurations excluded.
OSWorld 2.0 — Anthropic H2H: 66.9%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 66.9 for Muse Spark 1.3 on OSWorld 2.0 — Anthropic H2H still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
JobBench: 61.2%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 61.2 for Muse Spark 1.3 on JobBench still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
τ³-Banking: 52.371134%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (max); Artificial Analysis published evaluation harness
Metric: strict task success, AA
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
CritPt: 26%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: Muse Spark 1.3 (xhigh); Artificial Analysis published evaluation harness
Metric: accuracy, AA official grading
Original source · Retrieved 2026-09-06
Best published result among 2 reasoning configurations of the exact AA model release; fallback configurations excluded.
MineBench: 1836 native-points
Not used in the score. Source category not recorded. Review status: excluded.
Unresolved Pro/base model identities in source catalog; exclude until matched.
OSWorld 2.0: 32%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 32 for Muse Spark 1.3 on OSWorld 2.0 still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
Harvey LAB-AA: 95.48%
Not used in the score. Source category not recorded. Review status: unresolved.
Not admitted after the September 6 model review: the collected 95.48 for Muse Spark 1.3 on Harvey LAB-AA still lacks a matched source entry establishing its checkpoint and benchmark-specific metric, tools and retry setup. This is a citation/comparability gap, not a finding that the result is false or useless. More or maximum reasoning effort is not required.
Tax Agent Bench v1 — Vals: 71.93%
Contributes to the score. Source category: independent. Review status: reviewed-independent.
Configuration: meta_muse_spark_1_3; Vals xhigh effort
Metric: tax_agent_bench overall percentage in Vals benchmark harness
Original source · Retrieved 2026-09-06
Reconciled against the exact model/configuration in the evaluator’s public source. Updated source value recorded explicitly; best published reasoning mode selected within the same benchmark protocol.
RuneBench (30m, mean ln(1 + XP/min)): 4.58575 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: muse13
Metric: Arithmetic mean of ln(1 + peakXpRate) over all 16 skills, exactly as the owner’s Heatmap.js default ranking. Data rates are already normalized; do not divide by 200 again.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Roboflow Vision Evals (six-task mean, high tier): 77.733333%
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: Require a complete six-task high-tier panel, the highest published benchmark tier. Retain high-tier scores even when lower than low-tier. Do not substitute the best of three repetitions: use the published mean. Each panel enters the fit once; do not also fit its components.
Metric: Arithmetic mean of six published high-tier task means; derived by The Latent, not Roboflow’s official low-tier overall score.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Code Arena WebDev (overall): 1622 native-points
Contributes to the score. Source category: independent. Review status: reviewed-archive.
Configuration: muse-spark-1.3 (xHigh)
Metric: Published overall WebDev preference rating, not task success percentage or Arena Text score.
Original source · Retrieved 2026-09-06
Matched exact metric/value and the archived benchmark-specific configuration review. Unknown native effort stays explicitly unknown.
Cite this model record
The Latent. “Muse Spark 1.3: score and benchmark evidence.” 2026-09-06. Release tli-2026-v1.0-2026-09-06-db.
Download release data and definitions (JSON) · Data usage terms