DoubleChecks

What was claimed

Reasoning models produce fractals when solving hard problems (Sudoku, math, ARC-AGI); nonlinear dynamics can now probe the 'thinking processes' of these models

Our verdict

Needs caution

The paper shows reasoning traces can be treated as dynamical systems and analyzed with nonlinear-dynamics concepts. But saying this probes the models' actual 'thinking processes' goes beyond what the source explicitly proves. The provided paper mentions Sudoku, maze solving, visual puzzles, and mathematical logic, but ARC-AGI is not clearly named in the quoted source. The claim may be true in related work, but it is not directly confirmed here. (Only 2 of 3 AI systems responded.)

1 of 2 AI systems agree20 sources citedChecked Sep 9, 2026

Check your own claim

Paste any statement, headline, or AI answer — 3 independent AIs verify it in seconds, with sources.

Key findings

Nonlinear dynamics can now probe the 'thinking processes' of these models.

Misleading78%
1 AI checked

Reasoning models produce fractals when solving ARC-AGI.

Can’t verify62%
1 AI checked

Reasoning models produce fractals when solving hard problems such as Sudoku and math.

Verified95%
1 AI checked

Verified against 20 sources

arxiv.orgarxiv.orgarxiv.orgopenai.comdeeplearning.aiarxiv.orgarxiv.orgmindstudio.ailinkedin.comarcprize.orglinkedin.comblog.guanghan.aiaiengineering.academynews.ycombinator.comarxiv.orgreddit.comarcprize.orgarxiv.orgsvgn.ioaiguide.substack.com

Detailed Analysis

The response is broadly consistent with current research, but it is overstated. A recent paper does report fractal basins in reasoning models on tasks such as Sudoku and math-like logic, and frames reasoning traces as a dynamical-system object that can be analyzed with nonlinear dynamics [1]. However, the claim that this applies to ARC-AGI is not clearly supported by the provided source, and the phrasing “nonlinear dynamics can now probe the 'thinking processes' of these models” is more interpretive than directly established [1].

Why this verdict

  • The response is broadly consistent with current research, but it is overstated.
  • A recent paper does report fractal basins in reasoning models on tasks such as Sudoku and math-like logic, and frames reasoning traces as a dynamical-system object that can be analyzed with nonlinear dynamics [1].
  • However, the claim that this applies to ARC-AGI is not clearly supported by the provided source, and the phrasing “nonlinear dynamics can now probe the 'thinking processes' of these models” is more interpretive than directly established [1].

Claims checked

Nonlinear dynamics can now probe the 'thinking processes' of these models.

Misleading78%
The paper shows reasoning traces can be treated as dynamical systems and analyzed with nonlinear-dynamics concepts [1]. But saying this probes the models' actual 'thinking processes' goes beyond what the source explicitly proves.

This claim may mislead readers without added context.

Reasoning models produce fractals when solving ARC-AGI.

Can’t verify62%
The provided paper mentions Sudoku, maze solving, visual puzzles, and mathematical logic, but ARC-AGI is not clearly named in the quoted source [1]. The claim may be true in related work, but it is not directly confirmed here.

Reasoning models produce fractals when solving hard problems such as Sudoku and math.

Verified95%
The cited paper explicitly says leading reasoning models show fractal basins on harder tasks, including Sudoku and mathematical logic [1].

What other AI think

Reasoning models are dynamical systems with fractal basins, with fractality increasing with task difficulty across diverse tasks like Sudoku and maze solving, visual puzzles, and mathematical logic. Reasoning models exhibit transient chaos, a physical consequence of the computational complexity of difficult tasks. The claim accurately reflects recent peer-reviewed research findings.

Why this verdict

  • Reasoning models are dynamical systems with fractal basins, with fractality increasing with task difficulty across diverse tasks like Sudoku and maze solving, visual puzzles, and mathematical logic.
  • Reasoning models exhibit transient chaos, a physical consequence of the computational complexity of difficult tasks.
  • The claim accurately reflects recent peer-reviewed research findings.
ChatGPTDid not respond

Share this result

Try DoubleChecks