A new physics benchmark with static and dynamically varied numeric problems shows top LLMs solve at most 43 percent of the static set and drop sharply when problem constants change.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
A new physics benchmark with static and dynamically varied numeric problems shows top LLMs solve at most 43 percent of the static set and drop sharply when problem constants change.