Frontier thinking models degrade sharply on procedurally scaled 'easy' reasoning tasks and fail on curated trivialized puzzles, often by regurgitating the original puzzle's solution.
One checks that under each of the above transformations, S remains unchanged (that is, S is an invariant modulo 3)
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Frontier LLMs Still Struggle with Simple Reasoning Tasks
Frontier thinking models degrade sharply on procedurally scaled 'easy' reasoning tasks and fail on curated trivialized puzzles, often by regurgitating the original puzzle's solution.