LLM Theory of Mind benchmarks focus on logical inference at a fixed mentalizing depth, but overlook the prior step of deciding whether and how deep to mentalize, which the paper argues should be measured with interactive, dynamic evaluation.
InProceedings of the 62nd Annual Meeting of the Association for Compu- tational Linguistics (Volume 1: Long Papers), pages 15959–15983, Bangkok, Thailand
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Mind Your Theory: Theory of Mind Goes Deeper Than Reasoning
LLM Theory of Mind benchmarks focus on logical inference at a fixed mentalizing depth, but overlook the prior step of deciding whether and how deep to mentalize, which the paper argues should be measured with interactive, dynamic evaluation.