DoubleChecks

What was claimed

In December 2024 o3-preview scored 87.5% on ARC-AGI-1 at >$4500 per task. In July 2026 DeepSeek-V4-Flash scored 87% at $0.021 per task. By 2028 open-source models will crack hard math problems in under an hour; the mathematics profession will have to change

Our verdict

Needs caution

DeepSeek V4 Flash 0731 scored 89.0% on ARC-AGI-1, not 87%. This is a 2-point factual error. Benchmark analyses describe o3’s high-compute ARC-AGI-1 runs as costing thousands of dollars per task, but reported cost-per-task figures vary, with one detailed table giving around $4,560 per task and others giving broader ranges. The claim’s ">$4500" threshold is directionally correct but presented as a precise figure despite these discrepancies. (Only 2 of 3 AI systems responded.)

All 2 AI systems agree15 sources citedChecked Sep 12, 2026

Check your own claim

Paste any statement, headline, or AI answer — 3 independent AIs verify it in seconds, with sources.

Key findings

In July 2026 DeepSeek-V4-Flash scored 87% on ARC-AGI-1

Incorrect95%
1 AI checked

In July 2026 DeepSeek-V4-Flash scored 87% on ARC-AGI-1 at $0.021 per task

Misleading83%
2 of 4 AIs agree·Claude: Verified, Perplexity: Verified

o3-preview cost >$4500 per task

Misleading85%
1 AI checked

The mathematics profession will have to change

Can’t verify40%
1 AI checked

By 2028 open-source models will crack hard math problems in under an hour; the mathematics profession will have to change

Can’t verify55%
All 2 AIs agree

DeepSeek-V4-Flash cost $0.021 per task

Verified90%
1 AI checked

Verified against 15 sources

arcagibook.comarcprize.orgtechcrunch.comaiwiki.aiashitaorbis.comrdworldonline.comvalueaddvc.comx.comtechmeme.comfortune.comaiwiki.ainextbigfuture.comarcprize.orglinkedin.comversionman.com

Detailed Analysis

The claims about o3-preview’s ARC-AGI-1 score and very high per-task cost are broadly consistent with published benchmarks, though the exact dollar figure is not stable across sources. The DeepSeek-V4-Flash numbers differ slightly from at least one benchmark report, and the 2028 prediction about math and open-source models is speculative and not verifiable. Overall, the statement mixes accurate benchmark facts with approximate costs and an unverifiable forecast.

Why this verdict

  • The claims about o3-preview’s ARC-AGI-1 score and very high per-task cost are broadly consistent with published benchmarks, though the exact dollar figure is not stable across sources.
  • The DeepSeek-V4-Flash numbers differ slightly from at least one benchmark report, and the 2028 prediction about math and open-source models is speculative and not verifiable.
  • Overall, the statement mixes accurate benchmark facts with approximate costs and an unverifiable forecast.

Claims checked

In July 2026 DeepSeek-V4-Flash scored 87% on ARC-AGI-1 at $0.021 per task

Misleading80%
At least one benchmark-style review reports DeepSeek V4 Flash reaching about 89% on ARC-AGI-1 Semi-Private at roughly $0.02 per task, which is close but not identical to 87% and $0.021. The claim appears to approximate these numbers rather than reflect an exact, cited result.

This claim may mislead readers without added context.

In December 2024 o3-preview scored 87.5% on ARC-AGI-1 at >$4500 per task

Misleading85%
Benchmark analyses describe o3’s high-compute ARC-AGI-1 runs as costing thousands of dollars per task, but reported cost-per-task figures vary, with one detailed table giving around $4,560 per task and others giving broader ranges. The claim’s ">$4500" threshold is directionally correct but presented as a precise figure despite these discrepancies.

This claim may mislead readers without added context.

By 2028 open-source models will crack hard math problems in under an hour; the mathematics profession will have to change

Can’t verify60%
This is a forward-looking prediction about capabilities and social impact, not a current factual statement. There is no authoritative, empirical evidence that can confirm or invalidate this specific forecast at present.

What other AI think

The statement contains one factual error (DeepSeek-V4-Flash score is 89%, not 87%) and two unverifiable future predictions. The o3-preview claims are essentially accurate, though the cost notation is slightly imprecise. The future claims about 2028 and mathematics profession changes cannot be verified.

Why this verdict

  • The statement contains one factual error (DeepSeek-V4-Flash score is 89%, not 87%) and two unverifiable future predictions.
  • The o3-preview claims are essentially accurate, though the cost notation is slightly imprecise.
  • The future claims about 2028 and mathematics profession changes cannot be verified.

Claims checked

In July 2026 DeepSeek-V4-Flash scored 87% on ARC-AGI-1

Incorrect95%
DeepSeek V4 Flash 0731 scored 89.0% on ARC-AGI-1, not 87%. This is a 2-point factual error.

This claim may mislead readers without added context.

o3-preview cost >$4500 per task

Misleading85%
The cost was approximately $4,500 per task, not exceeding it. The '>' symbol suggests a higher cost than the actual estimate.

This claim may mislead readers without added context.

The mathematics profession will have to change

Can’t verify40%
This is a speculative claim about professional consequences that cannot be verified from available sources or evidence.
ChatGPTDid not respond

Share this result

Try DoubleChecks