pith. sign in

arxiv: 2502.20349 · v4 · pith:OIZAJDRBnew · submitted 2025-02-27 · 🧬 q-bio.NC · cs.AI

Naturalistic Computational Cognitive Science: Towards generalizable models and theories that capture the full range of natural behavior

Wilka Carvalho , Andrew Lampinen This is my paper

Pith reviewed 2026-05-23 02:36 UTC · model grok-4.3

classification 🧬 q-bio.NC cs.AI
keywords naturalistic paradigmscomputational modelinggeneralizationcognitive scienceartificial intelligenceneuroscienceexperimental methodsnatural behavior
0
0 comments X

The pith

Cognitive science must shift to naturalistic experiments and AI-accommodating models to build theories that generalize to natural behavior.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper argues that many aspects of natural intelligence may remain unresolved unless cognitive science expands beyond traditional controlled lab settings to include a wider range of naturalistic stimuli, tasks, and behaviors. Evidence from neuroscience and cognitive science shows cases where naturalistic conditions produce distinct behaviors or recruit different processes than artificial ones. Advances in AI demonstrate that models trained on naturalistic data yield qualitatively different generalization patterns, which in turn can generate new hypotheses about cognitive and neural mechanisms. The authors propose that combining these AI capabilities with cognitive science methods allows engagement with real-world phenomena while retaining experimental control and theoretical grounding. They provide practical methodological suggestions for building cumulative progress toward computational models that both solve natural cognition problems and explain the underlying principles.

Core claim

Incorporating a broader range of naturalistic experimental paradigms, along with computational models that can accommodate them, is necessary to resolve some aspects of natural intelligence and to ensure that theories generalize beyond the lab.

What carries the argument

Naturalistic computational cognitive science, the integration of naturalistic experimental paradigms with AI-derived models capable of handling complex real-world data.

If this is right

  • Cognitive theories will need to account for behaviors and processes that only appear under naturalistic conditions.
  • AI models trained on naturalistic data can supply new hypotheses about the roots of cognitive and neural phenomena.
  • Computational models can be built that solve the actual problems of natural cognition while providing reductive explanations of their operation.
  • Methodological practices can be adjusted to support cumulative progress without sacrificing experimental control.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • This approach could change how experiments are designed in areas like decision-making or perception by prioritizing tasks that mirror everyday environments.
  • It raises the possibility that some current debates in cognitive science stem from the artificial constraints of lab tasks rather than fundamental disagreements about mechanisms.
  • Testing whether AI models trained naturalistically better predict human behavior in uncontrolled settings would provide a direct check on the claim.

Load-bearing premise

Differences seen in some naturalistic settings reflect a general requirement to change methods across the field rather than isolated cases that existing frameworks can already address.

What would settle it

A demonstration that standard lab paradigms and models without naturalistic elements can fully predict and explain the key behaviors and processes observed in real-world cognitive tasks across multiple domains.

Figures

Figures reproduced from arXiv: 2502.20349 by Andrew Lampinen, Wilka Carvalho.

Figure 1
Figure 1. Figure 1: Naturalistic computational cognitive science: the what, why, and the how. The first section (§2) provides an overview of “naturalistic computational cognitive science”. In (§3-§4), we motivate using naturalistic experimental paradigms and learning-based ap￾proached for cognitive research. The remaining sections (§5-§6) focuses on how to achieve these goals; how to develop models for naturalistic settings, … view at source ↗
Figure 2
Figure 2. Figure 2: Overview of naturalistic computational cognitive science. Given a novel computa [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Examples of increasingly naturalistic settings that we can now study in a theory-driven manner. All of these are settings where tasks and stimuli can now be para￾metrically generated—i.e., thanks to “generative AI”, we can now automate the generation of photorealistic synthetic data and virtual worlds; thanks to virtual and augmented reality, we can now scan and parametrically manipulate real environments.… view at source ↗
Figure 4
Figure 4. Figure 4: Overview of the benefits of increasingly naturalisic experimental conditions. [PITH_FULL_IMAGE:figures/full_fig_p009_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Overview of the benefits of learning with naturalistic data. (Figures reproduced [PITH_FULL_IMAGE:figures/full_fig_p014_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Overview of key strategies cognitive science can adopt to develop generalizable [PITH_FULL_IMAGE:figures/full_fig_p019_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Overview of how we can develop theories with potentially opaque models and [PITH_FULL_IMAGE:figures/full_fig_p026_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Testing hypotheses by parametrically manipulating naturalistic data. In the natural [PITH_FULL_IMAGE:figures/full_fig_p027_8.png] view at source ↗
read the original abstract

How can cognitive science build generalizable theories that span the full scope of natural situations and behaviors? We argue that progress in Artificial Intelligence (AI) offers timely opportunities for cognitive science to embrace experiments with increasingly naturalistic stimuli, tasks, and behaviors; and computational models that can accommodate these changes. We first review a growing body of research spanning neuroscience, cognitive science, and AI that suggests that incorporating a broader range of naturalistic experimental paradigms, and models that accommodate them, may be necessary to resolve some aspects of natural intelligence and ensure that our theories generalize. We review cases from cognitive science and neuroscience where naturalistic paradigms elicit distinct behaviors or engage different processes. We then discuss recent progress in AI that shows that learning from naturalistic data yields qualitatively different patterns of behavior and generalization, and examine how these findings impact the conclusions we draw from cognitive modeling, and can help yield new hypotheses for the roots of cognitive and neural phenomena. We then suggest that integrating recent progress in AI and cognitive science will enable us to engage with more naturalistic phenomena without giving up experimental control or the pursuit of theoretically grounded understanding. We offer practical guidance on how methodological practices can contribute to cumulative progress in naturalistic computational cognitive science, and illustrate a path towards building computational models that solve the real problems of natural cognition, together with a reductive understanding of the processes and principles by which they do so.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 0 minor

Summary. The manuscript is a perspective piece arguing that cognitive science should adopt more naturalistic experimental paradigms (stimuli, tasks, behaviors) and computational models capable of accommodating them in order to build generalizable theories spanning the full range of natural situations. It reviews cases from cognitive science and neuroscience where naturalistic paradigms produce distinct behaviors or engage different processes, draws parallels to AI results showing qualitatively different generalization from naturalistic data, and offers practical guidance for integrating these approaches while preserving experimental control and theoretical grounding.

Significance. If the argument holds, the perspective could encourage a productive shift toward ecologically valid yet controlled research, helping resolve discrepancies in understanding natural intelligence and fostering cumulative progress by bridging cognitive science with recent AI advances on naturalistic data. The manuscript's value lies in its synthesis of existing literature and appropriately hedged claims rather than new quantitative evidence or derivations.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for their positive and constructive review. We are pleased that the manuscript's synthesis of existing literature, appropriately hedged claims, and potential to foster integration between naturalistic paradigms and AI models were recognized, and we appreciate the recommendation to accept.

Circularity Check

0 steps flagged

No significant circularity

full rationale

The paper is a perspective/review article with no mathematical derivations, equations, fitted parameters, or formal models. Its arguments rest on reviews of external literature from cognitive science, neuroscience, and AI, with hedged claims about the potential value of naturalistic paradigms. No self-citations function as load-bearing uniqueness theorems or ansatzes, and no predictions reduce by construction to the paper's own inputs. The central thesis is interpretive advocacy rather than a deductive chain, making the derivation self-contained against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

This is a perspective paper with no mathematical model, data fitting, or new postulates; it relies on existing literature in cognitive science, neuroscience, and AI without introducing free parameters, axioms, or invented entities.

pith-pipeline@v0.9.0 · 5774 in / 1030 out tokens · 22389 ms · 2026-05-23T02:36:13.250552+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Active inference as a unified model of collision avoidance behavior in human drivers

    cs.RO 2025-06 unverdicted novelty 5.0

    Active inference model unifies human collision avoidance by reproducing meta-analysis aggregates and simulator-specific effects on response timing, maneuver selection, and execution.

Reference graph

Works this paper leans on

24 extracted references · 24 canonical work pages · cited by 1 Pith paper · 3 internal anchors

  1. [1]

    P., and Singh, S

    Abel, D., Barreto, A., Van Roy, B., Precup, D., van Hasselt, H. P., and Singh, S. (2024). A definition of continual reinforcement learning. Advances in Neural Information Processing Systems,

    work page 2024

  2. [2]

    S., Courville, A

    Agarwal, R., Schwarzer, M., Castro, P. S., Courville, A. C., and Bellemare, M. (2021). Deep reinforcement learning at the edge of the statistical precipice. Advances in neural information processing systems , 34:29304–29320. Allen, K., Br¨ andle, F., Botvinick, M., Fan, J. E., Gershman, S. J., Gopnik, A., Griffiths, T. L., Hartshorne, J. K., Hauser, T. U....

    work page 2021

  3. [3]

    and Yamins, D

    Cao, R. and Yamins, D. (2024a). Explanatory models in neuroscience, part 1: Taking mech- anistic abstraction seriously. Cognitive Systems Research , page 101244. Cao, R. and Yamins, D. (2024b). Explanatory models in neuroscience, part 2: Functional intelligibility and the contravariance principle. Cognitive Systems Research , 85:101200. Carlson, R. W. and...

    work page arXiv 2018

  4. [4]

    Chomsky, N. (1957). Syntactic structures . Mouton de Gruyter. Chomsky, N. (1965). Aspects of the Theory of Syntax . MIT press. Chomsky, N. (2014). The minimalist program . MIT press. Cichy, R. M. and Kaiser, D. (2019). Deep neural networks as scientific models. Trends in cognitive sciences , 23(4):305–317. Cisek, P. (1999). Beyond the computer metaphor: B...

    work page arXiv 1957

  5. [5]

    Elman, J. L. (1996). Rethinking innateness: A connectionist perspective on development , volume

    work page 1996

  6. [6]

    Engelhard, I

    MIT press. Engelhard, I. M., van den Hout, M. A., and McNally, R. J. (2008). Memory consistency for traumatic events in dutch soldiers deployed to iraq. Memory, 16(1):3–9. Erev, I. and Greiner, B. (2015). The 1-800 critique, counter-examples, and the future of behavioral economics. Handbook of experimental economic methodology , pages 151–165. Fan, L., Wa...

    work page arXiv 2008

  7. [7]

    Fodor, J

    Harvard university press Cambridge, MA. Fodor, J. A. and Pylyshyn, Z. W. (1988). Connectionism and cognitive architecture: A critical analysis. Cognition, 28(1-2):3–71. Francis, K. B., Terbeck, S., Briazu, R. A., Haines, A., Gummerum, M., Ganis, G., and Howard, I. S. (2017). Simulating moral actions: An investigation of personal force in virtual moral dil...

    work page 1988

  8. [8]

    Freeman, W. J. (1995). Chaos in the brain: Possible roles in biological intelligence. Interna- tional Journal of Intelligent Systems , 10(1):71–88. Fu, S., Tamir, N., Sundaram, S., Chai, L., Zhang, R., Dekel, T., and Isola, P. (2024). Dream- sim: Learning new dimensions of human visual similarity using synthetic data. Advances in Neural Information Proces...

    work page 1995

  9. [9]

    CoRR abs/1811.12231 (2018), http://arxiv.org/ abs/1811.12231

    Futrell, R., Gibson, E., Tily, H. J., Blank, I., Vishnevetsky, A., Piantadosi, S. T., and Fe- dorenko, E. (2021). The natural stories corpus: a reading-time corpus of english texts containing rare syntactic constructions. Language Resources and Evaluation , 55:63–77. Futrell, R. and Mahowald, K. (2025). How linguistics learned to stop worrying and love th...

    work page arXiv 2021

  10. [10]

    L., Chater, N., Kemp, C., Perfors, A., and Tenenbaum, J

    41 Griffiths, T. L., Chater, N., Kemp, C., Perfors, A., and Tenenbaum, J. B. (2010). Probabilis- tic models of cognition: Exploring representations and inductive biases. Trends in cognitive sciences, 14(8):357–364. Grim, P., Rosenberger, R., Rosenfeld, A., Anderson, B., and Eason, R. E. (2013). How simulations fail. Synthese, 190:2367–2390. Grimm, C., Bar...

    work page 2010

  11. [11]

    He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R

    Springer. He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R. (2020). Momentum contrast for unsu- pervised visual representation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 9729–9738. He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the...

    work page 2020

  12. [12]

    42 Henrich, J. (2016). The secret of our success: How culture is driving human evolution, domesticating our species, and making us smarter . princeton University press. Higgins, I., Chang, L., Langston, V., Hassabis, D., Summerfield, C., Tsao, D., and Botvinick, M. (2021). Unsupervised deep learning identifies semantic disentanglement in single infer- ote...

    work page arXiv 2016

  13. [13]

    Krypotos, A.-M., Vervliet, B., and Engelhard, I. M. (2018). The validity of human avoidance paradigms. Behaviour Research and Therapy , 111:99–105. 44 Laird, J. E. (2019). The Soar cognitive architecture . MIT press. Lake, B. M. and Baroni, M. (2023). Human-like systematic generalization through a meta- learning neural network. Nature, 623(7985):115–121. ...

    work page internal anchor Pith review Pith/arXiv arXiv 2018

  14. [14]

    Lee, I. (2014). Publish or perish: The myth and reality of academic publishing. Language teaching, 47(2):250–261. Lee, M. D. and Wagenmakers, E.-J. (2013). Bayesian cognitive modeling: A practical course . Cambridge university press. Levine, S., Finn, C., Darrell, T., and Abbeel, P. (2016). End-to-end training of deep visuo- motor policies. Journal of Mac...

    work page arXiv 2014

  15. [15]

    Lyle, C., Rowland, M., and Dabney, W. (2022). Understanding and preventing capacity loss in reinforcement learning. arXiv preprint arXiv:2204.09560. Machado, M. C., Bellemare, M. G., Talvitie, E., Veness, J., Hausknecht, M., and Bowling, M. (2018). Revisiting the arcade learning environment: Evaluation protocols and open problems for general agents. Journ...

    work page arXiv 2022

  16. [16]

    McCoy, R. T. and Griffiths, T. L. (2025). Modeling rapid language learning by distilling bayesian priors into artificial neural networks. Nature Communications , 16(1):1–14. Melis, G., Dyer, C., and Blunsom, P. (2017). On the state of the art of evaluation in neural language models. arXiv preprint arXiv:1707.05589. Merel, J., Botvinick, M., and Wayne, G. ...

    work page internal anchor Pith review Pith/arXiv arXiv 2025

  17. [17]

    , author Mahowald, K

    Misra, K. and Mahowald, K. (2024). Language models learn rare phenomena from less rare phenomena: The case of the missing aanns. arXiv preprint arXiv:2403.19827. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015). Human-level control through deep rein...

    work page arXiv 2024

  18. [18]

    Nanda, N., Chan, L., Lieberum, T., Smith, J., and Steinhardt, J. (2023). Progress measures for grokking via mechanistic interpretability. In The Eleventh International Conference on Learning Representations. Naselaris, T., Bassett, D. S., Fletcher, A. K., Kording, K., Kriegeskorte, N., Nienborg, H., Poldrack, R. A., Shohamy, D., and Kay, K. (2018). Cognit...

    work page 2023

  19. [19]

    D., Conway, A., Cowan, N., Donkin, C., Farrell, S., Hitch, G

    Oberauer, K., Lewandowsky, S., Awh, E., Brown, G. D., Conway, A., Cowan, N., Donkin, C., Farrell, S., Hitch, G. J., Hurlstone, M. J., et al. (2018). Benchmarks for models of short-term and working memory. Psychological bulletin , 144(9):885. Olshausen, B. A. and Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse ...

    work page arXiv 2018

  20. [20]

    A., Baker, C

    Poldrack, R. A., Baker, C. I., Durnez, J., Gorgolewski, K. J., Matthews, P. M., Munaf` o, M. R., Nichols, T. E., Poline, J.-B., Vul, E., and Yarkoni, T. (2017). Scanning the horizon: towards transparent and reproducible neuroimaging research. Nature reviews neuroscience , 18(2):115–126. Prystawski, B., Li, M., and Goodman, N. (2024). Why think step by ste...

    work page 2017

  21. [21]

    and Bowers, J

    Puebla, G. and Bowers, J. S. (2022). Can deep convolutional neural networks support rela- tional reasoning in the same-different task? Journal of Vision , 22(10):11–11. 49 Quilty-Dunn, J., Porot, N., and Mandelbaum, E. (2023). The best game in town: The reemergence of the language-of-thought hypothesis across the cognitive sciences. Behav- ioral and Brain...

    work page 2022

  22. [22]

    and Denison, R

    Rahnev, D. and Denison, R. N. (2018). Suboptimality in perceptual decision making. Be- havioral and brain sciences , 41:e223. Rahnev, D., Desender, K., Lee, A. L., Adler, W. T., Aguilar-Lleyda, D., Akdo˘ gan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., et al. (2020). The confidence database. Nature human behaviour , 4(3):317–325. Recht, B. (20...

    work page arXiv 2018

  23. [23]

    Yamins, D. L. and DiCarlo, J. J. (2016). Using goal-driven deep learning models to understand sensory cortex. Nature neuroscience , 19(3):356–365. Yamins, D. L., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., and DiCarlo, J. J. (2014). Performance-optimized hierarchical models predict neural responses in higher visual cortex. Proceedings of the nat...

    work page 2016

  24. [24]

    Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2014). Object detectors emerge in deep scene cnns. arXiv preprint arXiv:1412.6856. 55

    work page internal anchor Pith review Pith/arXiv arXiv 2014