Frontier thinking models degrade sharply on procedurally scaled 'easy' reasoning tasks and fail on curated trivialized puzzles, often by regurgitating the original puzzle's solution.
2) Notice that in any “meeting” of two different-colored chameleons, P, Y, M change according to one of these three rules: P + Y → 2M, so (P, Y, M) becomes (P − 1, Y− 1, M+ 2)
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Frontier LLMs Still Struggle with Simple Reasoning Tasks
Frontier thinking models degrade sharply on procedurally scaled 'easy' reasoning tasks and fail on curated trivialized puzzles, often by regurgitating the original puzzle's solution.