Models that ace hard math benchmarks score much lower on a new benchmark of simple strategic board games, exposing a gap in basic reasoning.
oTTT test sample example in Figure 1 Question: Alice and Bob are playing a game on a 3x3 grid
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
TTT-Bench: A Benchmark for Evaluating Reasoning Ability with Simple and Novel Tic-Tac-Toe-style Games
Models that ace hard math benchmarks score much lower on a new benchmark of simple strategic board games, exposing a gap in basic reasoning.