Pith. sign in

REVIEW 3 major objections 5 minor 147 references

Gazing at Rewards: Eye Movements as a Lens into Human and AI Decision-Making in Hybrid Visual Foraging

T0 review · 3 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Pith's one-line read A reinforcement-learning agent reproduces human gaze and click decisions in hybrid visual foraging without any training on human data.

desk verdict A valuable new dataset and a credible RL model for hybrid visual foraging, but the behavioral-alignment claims are weakened by a shuffled-versus-static comparison, a tuned saccade parameter, and a mislabeled p-value. read the letter →

arxiv 2411.09176 v3 pith:F6VZDHNH submitted 2024-11-14 cs.AI cs.CV

classification cs.AIcs.CV
keywords hybridvisualforagingeyemovementsreinforcementlearningvalue-baseddecisionmakingfoveatedvisionsearchtransformerscanpathprediction
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

In hybrid visual foraging—searching a cluttered display for multiple instances of several target types that carry different rewards—humans behave as efficient reward foragers: their fixations land in high-reward regions, they linger longer on more valuable targets, and their cumulative rewards approach an optimal upper bound. This paper asks whether an artificial agent can acquire the same gaze-and-click policy purely from the reward structure of the task, without any supervised training on human eye or mouse data. The authors introduce Visual Forager (VF), a transformer-based reinforcement-learning agent with foveated vision, and report that it outperforms all tested baselines, achieves rewards comparable to human participants, and approximates human click biases and saccade-size distributions. If the claim holds, VF is the first model to reproduce human hybrid-foraging behavior—including where the eyes go—from reward maximization alone, and it offers a computational tool for probing the link between oculomotor decisions and value-based choice.

What carries the argument

The load-bearing mechanism is the Visual Forager's value-modulated, foveated policy network. A VGG16 backbone with eccentricity-dependent pooling (replicated from macaque neurophysiology) converts the search image into fixation-dependent feature maps; target features are matched to those maps by convolution to form similarity maps; a learnable value encoder's embedding is added at every spatial location, so that the value of each target type directly reshapes the priority map; and a vision transformer over these value-modulated maps outputs a softmax fixation map plus a click probability, trained jointly by PPO with a two-stage curriculum (first fixations with full resolution and infinite inhibition of return, then clicks with eccentricity-dependent vision and a decaying memory of visited locations). This design lets value and visual similarity interact inside the policy rather than being combined heuristically.

What would settle it

Run VF in a foraging environment where item positions are reshuffled every three seconds, exactly as in the human experiment, keeping all reward and time-cost parameters equal. If VF's normalized scores, click-bias ratios, or saccade-size distributions no longer track the human data under this shuffling, the central claim that VF approximates human foraging behavior without human data is falsified.

Watch

Extended reading notes

Core claim

The central claim is that a value-guided reinforcement learner, with no human behavioral data, can converge on the same foraging policy that humans use when target values and prevalence vary. Specifically, VF reads in a search image, the target templates, and their monetary values; a foveated feature extractor, with eccentricity-dependent pooling modelled on the primate visual system, produces fixation-dependent similarity maps; a value encoder adds target values into those maps; and a transformer actor-critic decides both where to fixate next and whether to click the currently fixated item. Trained with PPO under a curriculum, VF is reported to reach 72.6%, 67.1%, and 81.6% normalized scores in the three in-domain conditions (humans: 87.4%, 84.1%, 93.1%), to share the sign of human click-bias ratios for high- and low-valued targets, and to produce a mean saccade size of 4.06 degrees versus 4.05 degrees for humans, despite zero training on human eye movements. The paper interprets this as evidence that eye-movement policies in hybrid foraging are largely learned from reward structure, and that fixation decisions are a reliable lens on value-based decision-making.

Load-bearing premise

The match between humans and VF assumes that the simplified grid world with fixed item positions and constant per-click and per-fixation time costs faithfully captures human foraging strategy, even though the human experiment shuffled item positions every three seconds and the AI environments did not.

Editorial extensions

If this is right

  • VF achieves human-comparable cumulative rewards and closer-to-human scanpaths than all baselines in time-limited hybrid foraging, suggesting that reward maximization alone can induce human-like search priorities.
  • VF reproduces the human overpicking of high-value targets and underpicking of low-value targets, so value-driven click biases need not be trained from human examples.
  • The saccade-size match implies that human-like fixation step lengths emerge partly from foveated processing rather than from explicit oculomotor constraints.
  • VF generalizes to out-of-distribution conditions—unseen target objects, unseen value ranges, different item counts and set sizes—better than the strongest baseline, indicating that the learned value-modulation policy is transferable.
  • Eye fixation locations and durations carry measurable signatures of reward, giving a non-invasive readout of subjective value during search.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct test of the model's causal claim would be to remove target values from the input: the paper's analysis predicts fixations and click biases should then flatten toward chance, offering a falsifiable dissociation between feature-driven and value-driven guidance.
  • The human experiment shuffled item positions every three seconds while the AI environments did not, so adding the same periodic shuffle to VF's environment would test whether the reported human–AI alignment persists under working-memory load; this is an extension the paper does not run.
  • The VF architecture effectively produces a dynamic priority map that is updated by value after each fixation; that map could be repurposed as a generative model of scanpaths in other multi-target tasks, or as a synthetic data source for training models of attention.
  • The paper's finding that fixation durations scale with target value suggests a natural extension: an augmented VF that predicts fixation durations, rather than only locations, would let the model speak directly to the time-cost trade-offs humans face in foraging.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper introduces a hybrid visual foraging task with varying target values and prevalence, reports a human eye-tracking experiment, and proposes Visual Forager (VF), a transformer-based reinforcement-learning agent that sequentially produces fixation locations and click decisions. The authors claim that VF outperforms all baselines, achieves cumulative rewards comparable to humans, approximates human eye-movement statistics and click biases without supervised training on human data, and generalizes to out-of-distribution conditions. The supplementary material contains implementation details, ablations, and additional analyses.

Significance. If the central claims hold, the paper makes a valuable contribution: it provides a large human eye-tracking dataset for hybrid visual foraging and demonstrates that an RL agent, not trained on human gaze data, can reproduce several qualitative features of human foraging, including value-guided click biases and approximate saccade-size distributions. The central Norm.Score results are clearly presented, VF consistently outperforms the considered baselines, and the authors provide code, data, and models. The generalization tests to unseen targets, values, set sizes, and item numbers are a useful stress test. However, three load-bearing issues—the shuffled versus static environment mismatch, the unsupported fixation-duration significance claim, and the calibrated saccade-size comparison—need to be resolved before the behavioral-alignment claim is fully established.

major comments (3)
  1. [§3.2, Appendix S1.1, Appendix S3.9] The human and AI foraging environments differ in a way that confounds the quantitative human–VF comparisons. Appendix S1.1 states that item positions in human trials are shuffled every 3 seconds, while the AI environments described in §3.2 and Appendix S1.2 do not include any shuffling. The paper restricts its qualitative scanpath example to pre-shuffle data only in Appendix S3.9, but Figures 4 and 5, Table S4, and Figures S4 and S5 report full-trial aggregated metrics such as Norm.Score, CBR, saccade size, and fixation-area rewards. After a shuffle, humans must re-localize targets and may change both fixation and click policies, whereas VF never faces this change. Unless all quantitative human–VF comparisons are also restricted to the interval before the first shuffle, or the AI environment is modified to include shuffling, the reported behavioral alignment may reflect two different tasks rather than similar foraging policies. This issue is load-bearing because the central claim is precisely that VF approximates human gaze-and-click behavior.
  2. [Appendix S3.3, §5.2, Abstract] The fixation-duration claim is not supported by the reported statistics. Appendix S3.3 reports p = 0.13 for UnValEqPre and p = 0.12 for UnValUnPre, yet the text states that "fixation durations are significantly different for targets with different values" in those conditions. With conventional thresholds, p > 0.05 indicates no significant difference. The Abstract and §5.2 rely on this claim when stating that fixation durations are longer on more valuable targets. The authors should either report a properly powered and correctly specified statistical test that supports the claim, or reframe the finding as a descriptive trend and remove it from the paper's central contributions.
  3. [Appendix S1.4, Table S1, §5.3] The saccade-size match is partly calibrated, so the claim that VF "approximates the saccade size distributions of humans, without training on human eye movements" needs qualification. Table S1 shows that the eccentricity-dependent pooling scaling factor β was varied and set to β = 1 because it yields a mean saccade size of 4.06 dva, closely matching the human value of 4.05 dva. Because β was selected on the basis of human saccade data, the favorable saccade-size comparison is not an emergent property of the RL-trained policy alone. The authors should acknowledge this parameter selection explicitly, report results across β values, or provide a principled a priori justification for β = 1.
minor comments (5)
  1. [§3.2 vs Appendix S1.2] There is an inconsistency in the target values used for training: §3.2 states that values are set at 2, 4, 8, and 16, while Appendix S1.2 says values are consistently set at 2, 4, 8, and 12. Please reconcile these statements.
  2. [§5.2 heading] The heading "Eye movements are effected by target values" contains a typo; it should be "affected."
  3. [Appendix S3.3] The p-values in Figure S3 are reported without specification of the statistical test used; please state the test (e.g., ANOVA, Kruskal-Wallis, mixed-effects model) and the associated sample sizes or degrees of freedom.
  4. [Appendix S1.3] The description of OOD - USetSize says "the set size of target objects was manipulated to include either one or two," but the name and surrounding text are ambiguous about whether this refers to the number of target types or the number of instances per type. Please clarify.
  5. [§4.4 and Appendix S3.7] The intrinsic blank-click penalty is introduced with a single value of -0.01, and Table S5 shows that the Norm.Score with this penalty is 72.6 while the model with no penalty achieves 79.9. The text says the penalty "has no significant effect," but the difference of 7.3 percentage points is not negligible; please provide a significance test or a discussion of why this difference is considered non-significant.

Circularity Check

1 steps flagged · score 6.0 of 10

The reported human-like saccade size is selected by tuning the pooling coefficient beta to match humans, so that specific eye-movement 'prediction' is a fitted input; the RL-trained foraging and click-bias results remain independent.

  1. fitted input called prediction [Sec. 5.3 (saccade-size claim); Appendix S1.4 and Table S1 (beta selection)]
    "To examine how the layer-specific scaling factor γl affects search efficiency and average saccade amplitudes, we varied γl by a coefficient β. Tab. S1 shows that increasing β reduces saccade size and cumulative rewards in UnValEqPre. VF with β = 1 best matches human saccades and achieves comparable rewards. ... Despite lacking prior training on human eye movements, VF yields a mean saccade size of 4.06 degree, closely approximating the mean saccade size of 4.05 degree for humans."

    The saccade-size match is not an emergent prediction: the model hyperparameter β in the eccentricity-dependent pooling was swept (β=1,2,4) and β=1 was selected explicitly because it 'best matches human saccades' (human 4.05 dva; β=1 gives 4.06 dva; β=2 gives 2.26 dva, Table S1). Reporting this selected value as 'approximates human saccade size' is a fitted input renamed as a prediction. The circularity is partial: CBR click biases, cumulative-reward ranking against baselines, and fixation-area reward analyses are not fitted to human gaze/click data and retain independent evidential value.

full rationale

The core VF derivation is not circular: fixation and click policies are trained with PPO on procedurally generated foraging environments without supervised human gaze or click labels, and the comparisons against Chance, FeatOnly, MaxVal, AvgVal, DQN, UpperBound, and OOD conditions are independent of the human data. The single clear circular step is the saccade-size 'prediction': Appendix S1.4/Table S1 show the eccentricity-pooling coefficient β was varied and β=1 was chosen because it best matches human saccades, and Sec. 5.3 then reports the 4.06 vs 4.05 dva agreement as if it were an unconstrained approximation. That specific eye-movement claim reduces to model selection. Two non-circular caveats should be weighed in the overall verdict. First, the 776 ms/click and 336 ms/fixation time costs are obtained by linear regression on human response data (Sec. 3.2, Figs. S1-S2) and imposed on the AI, so the 'cumulative rewards comparable to humans' result is partly constrained by imported human timing rather than being a pure prediction. Second, human trials shuffle item positions every 3 s (Appendix S1.1) while the AI environments do not shuffle, and Appendix S3.9 restricts its qualitative scanpath example to pre-shuffle data; the full-trial aggregate metrics in Figs. 4-5 and S3.4 are not similarly restricted, leaving a task-mismatch confound in the quantitative human-VF alignment. These are benchmark-validity concerns, not equation-level circularity, but they reinforce that the strongest human-likeness evidence should be read with caution. Overall, the central RL result has independent content, so the paper is partially circular rather than definitionally forced.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

The central claim rests on several hand-set parameters (beta, time costs, IOR decay) and domain assumptions about grid-world validity, foveated-vision fidelity, reward alignment, and feature sufficiency. No new physical entities are introduced.

free parameters (5)
  • beta (eccentricity-dependent pooling scaling multiplier) = 1
    In Tab S1, beta is varied and beta=1 is selected because it best matches human saccade size; the subsequent saccade-size match is therefore not fully independent.
  • time cost per mouse click = 776 ms
    Derived from linear regression on human response times (Fig S1); used to limit the AI's number of clicks per trial.
  • time cost per fixation = 336 ms
    Derived from linear regression on human fixation times (Fig S2); used to limit the AI's number of fixations per trial.
  • IOR decay constant eta = 0.8
    Chosen by hand for finite inhibition-of-return in stage 2; the paper does not report a sweep for this value.
  • intrinsic blank-click penalty = -0.01
    Ad hoc penalty for clicking blank cells; the ablation in Tab S5 shows only a small effect, so it is not load-bearing.
assumptions (5)
  • domain assumption Object search on a 16x16 grid with items from [14] captures the essential structure of hybrid visual foraging
    The paper generalizes from this simplified grid world to conclusions about human foraging; real-world occlusions and scene context are acknowledged as limitations in Appendix S4.
  • domain assumption Eccentricity-dependent pooling from [51] approximates human foveated vision
    VF's foveal processing is borrowed from [51], and beta is tuned on human data, but the pooling structure itself is taken as valid.
  • domain assumption The reward function (target value for a click, -1 for a distractor) matches human utility
    The same reward is applied to humans and models; if humans weight time or errors differently, the comparison is affected.
  • domain assumption Eye movements reflect decision-making processes
    The entire 'eye movements as a lens' argument rests on this standard assumption from the cited literature; it is not independently established here.
  • domain assumption ImageNet-pretrained VGG16 features provide sufficient semantic features for target recognition
    Frozen ImageNet weights are used; the model cannot acquire task-specific features, which may limit the relevance of the human comparison.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Gazing at Rewards: Eye Movements as a Lens into Human and AI Decision-Making in Hybrid Visual Foraging." pith.science (2026). https://pith.science/paper/F6VZDHNH

@misc{pith2026241109176,
  author       = {Pith},
  title        = {Pith review of: Gazing at Rewards: Eye Movements as a Lens into Human and AI Decision-Making in Hybrid Visual Foraging},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/F6VZDHNH}},
  note         = {Machine review of arXiv:2411.09176}
}
abstract

Imagine searching a collection of coins for quarters ($0.25$), dimes ($0.10$), nickels ($0.05$), and pennies ($0.01$)-a hybrid foraging task where observers look for multiple instances of multiple target types. In such tasks, how do target values and their prevalence influence foraging and eye movement behaviors (e.g., should you prioritize rare quarters or common nickels)? To explore this, we conducted human psychophysics experiments, revealing that humans are proficient reward foragers. Their eye fixations are drawn to regions with higher average rewards, fixation durations are longer on more valuable targets, and their cumulative rewards exceed chance, approaching the upper bound of optimal foragers. To probe these decision-making processes of humans, we developed a transformer-based Visual Forager (VF) model trained via reinforcement learning. Our VF model takes a series of targets, their corresponding values, and the search image as inputs, processes the images using foveated vision, and produces a sequence of eye movements along with decisions on whether to collect each fixated item. Our model outperforms all baselines, achieves cumulative rewards comparable to those of humans, and approximates human foraging behavior in eye movements and foraging biases within time-limited environments. Furthermore, stress tests on out-of-distribution tasks with novel targets, unseen values, and varying set sizes demonstrate the VF model's effective generalization. Our work offers valuable insights into the relationship between eye movements and decision-making, with our model serving as a powerful tool for further exploration of this connection. All data, code, and models are available at https://github.com/ZhangLab-DeepNeuroCogLab/visual-forager.

Figures

Figures reproduced from arXiv: 2411.09176 by the authors.

Figure 1
Figure 1. Illustrative example of eye movements and decision-making in a hybrid visual foraging task. The image depicts a real-world scenario where the goal is to search piles of coins for multiple instances of target coins with varying monetary values in order to maximize the accumulative monetary reward, within a time-limited environment. Yellow dots and arrows represent the locations and order of eye movements during the s… view at source ↗
Figure 2
Figure 2. Schematic of the hybrid visual foraging experiment. Each foraging trial starts with a 2-second center fixation (omitted here for simplicity), followed by the presentation of target images and their associated values (e.g., a plant valued at 4). To ensure human participants memorize the targets and their values, they must pass a recognition test by selecting all targets among distractors and correctly matching their … view at source ↗
Figure 3
Figure 3. Architecture overview of our Visual Forager. VF consists of three modules elaborated in Sec. 4: visual feature modulation from target images with foveated vision mimicking eccentricity-dependent sampling in human vision (Sec. 4.1), modulation from various values of different targets (Sec. 4.2), and decision-making process with an actor-critic transformer architecture, outputting next fixation locations from predicte… view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Humans and AI models are reward-seeking agents. We report the normalized scores (Norm. Score) as a function of click numbers for humans (red), our VF model (blue), and other baseline models (varying gray). Chance is in black. Three experimental conditions of foraging t…
Figure 5
Figure 5. Figure 5: (A) Our VF model has consistent clicking biases with humans. Humans (red) and our VF models (blue) share the same signs of CBR for most targets under UnValEqPre (a) and UnValUnPre (b). Chance (gray) has no preferences over target objects; hence, a CBR of 0. (B) Our VF …

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

147 extracted references · 68 canonical work pages

  1. [1]

    Maximum a posteriori policy optimisation

    Abbas Abdolmaleki, Jost Tobias Springenberg, Yuval Tassa, Remi Munos, Nicolas Heess, and Martin Riedmiller. Maximum a posteriori policy optimisation. arXiv preprint arXiv:1806.06920, 2018. 2

  2. [2]

    Deep-bcn: Deep networks meet biased competition to create a brain-inspired model of attention control

    Hossein Adeli and Gregory Zelinsky. Deep-bcn: Deep networks meet biased competition to create a brain-inspired model of attention control. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pages 1932–1942, 2018. 2

  3. [3]

    Persistence of value-driven attentional capture

    Brian A Anderson and Steven Yantis. Persistence of value-driven attentional capture. Journal of Experimental Psychology: Human Perception and Performance, 39(1):6,

  4. [4]

    Value-driven attentional capture

    Brian A Anderson, Patryk A Laurent, and Steven Yantis. Value-driven attentional capture. Proceedings of the National Academy of Sciences , 108(25):10367–10371,

  5. [5]

    Learning dexterous in-hand manipulation

    OpenAI: Marcin Andrychowicz, Bowen Baker, Maciek Chociej, Rafal Jozefowicz, Bob McGrew, Jakub Pachocki, Arthur Petron, Matthias Plappert, Glenn Powell, Alex Ray, et al. Learning dexterous in-hand manipulation. The International Journal of Robotics Research , 39(1):3–20,

  6. [6]

    Boosted visual performance after eye blinks

    Jit Wei A Ang and Gerrit W Maus. Boosted visual performance after eye blinks. Journal of Vision , 20(10): 2–2, 2020. 2

  7. [7]

    Rudder: Return decomposition for delayed rewards

    Jose A Arjona-Medina, Michael Gillhofer, Michael Widrich, Thomas Unterthiner, Johannes Brandstetter, and Sepp Hochreiter. Rudder: Return decomposition for delayed rewards. Advances in Neural Information Processing Systems, 32, 2019. 3

  8. [8]

    Multiple object recognition with visual attention

    Jimmy Ba, V olodymyr Mnih, and Koray Kavukcuoglu. Multiple object recognition with visual attention. arXiv preprint arXiv:1412.7755, 2014. 2

Show all 147 references
  1. [9]

    Confidence controls perceptual evidence accumulation

    Tarryn Balsdon, Valentin Wyart, and Pascal Mamassian. Confidence controls perceptual evidence accumulation. Nature communications, 11(1):1753, 2020. 2

  2. [10]

    Reaction time latencies of eye and hand movements in single-and dual-task conditions

    Harold Bekkering, Jos J Adam, Herman Kingma, A Huson, and HTA Whiting. Reaction time latencies of eye and hand movements in single-and dual-task conditions. Experimental brain research, 97:471–476, 1994. 2

  3. [11]

    Dynamic programming and optimal control: Volume I

    Dimitri Bertsekas. Dynamic programming and optimal control: Volume I. Athena scientific, 2012. 2

  4. [12]

    Scene perception: Detecting and judging objects undergoing relational violations

    Irving Biederman, Robert J Mezzanotte, and Jan C Rabinowitz. Scene perception: Detecting and judging objects undergoing relational violations. Cognitive psychology, 14(2):143–177, 1982. 2

  5. [13]

    What/where to look next? modeling top-down visual attention in complex interactive environments

    Ali Borji, Dicky N Sihite, and Laurent Itti. What/where to look next? modeling top-down visual attention in complex interactive environments. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 44(5):523–538, 2013. 2

  6. [14]

    Visual long-term memory has a massive storage capacity for object details

    Timothy F Brady, Talia Konkle, George A Alvarez, and Aude Oliva. Visual long-term memory has a massive storage capacity for object details. Proceedings of the National Academy of Sciences , 105(38):14325–14329,

  7. [15]

    A bayesian optimal foraging model of human visual search

    Matthew S Cain, Edward Vul, Kait Clark, and Stephen R Mitroff. A bayesian optimal foraging model of human visual search. Psychological science , 23(9):1047–1054,

  8. [16]

    Fixation patterns in simple choice reflect optimal information sampling

    Frederick Callaway, Antonio Rangel, and Thomas L Griffiths. Fixation patterns in simple choice reflect optimal information sampling. PLoS computational biology, 17(3): e1008863, 2021. 2

  9. [17]

    Optimal foraging, the marginal value theorem

    Eric L Charnov. Optimal foraging, the marginal value theorem. Theoretical population biology , 9(2):129–136,

  10. [18]

    Predicting human scanpaths in visual question answering

    Xianyu Chen, Ming Jiang, and Qi Zhao. Predicting human scanpaths in visual question answering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10876–10885, 2021. 2

  11. [19]

    Beyond average: Individualized visual scanpath prediction

    Xianyu Chen, Ming Jiang, and Qi Zhao. Beyond average: Individualized visual scanpath prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 25420–25431, 2024. 2

  12. [20]

    Deep reinforcement learning-based dynamic resource management for mobile edge computing in industrial internet of things

    Ying Chen, Zhiyong Liu, Yongchao Zhang, Yuan Wu, Xin Chen, and Lian Zhao. Deep reinforcement learning-based dynamic resource management for mobile edge computing in industrial internet of things. IEEE Transactions on Industrial Informatics, 17(7):4925–4934, 2020. 3

  13. [21]

    Autoregressive generalized linear mixed effect models with crossed random effects: An application to intensive binary time series eye-tracking data

    Sun-Joo Cho, Sarah Brown-Schmidt, and Woo-yeol Lee. Autoregressive generalized linear mixed effect models with crossed random effects: An application to intensive binary time series eye-tracking data. Psychometrika, 83:751–771,

  14. [22]

    Eye movement analysis with switching hidden markov models

    Tim Chuk, Antoni B Chan, Shinsuke Shimojo, and Janet H Hsiao. Eye movement analysis with switching hidden markov models. Behavior research methods , 52: 1026–1043, 2020. 2

  15. [23]

    Task-evoked pupil responses reflect internal belief states

    Olympia Colizoli, Jan Willem de Gee, Anne E Urai, and Tobias H Donner. Task-evoked pupil responses reflect internal belief states. Scientific reports, 8(1):13702, 2018. 2

  16. [24]

    Dopamine and inhibitory action control: evidence from spontaneous eye blink rates

    Lorenza Serena Colzato, Wery PM Van Den Wildenberg, Nelleke C van Wouwe, Merel M Pannebakker, and Bernhard Hommel. Dopamine and inhibitory action control: evidence from spontaneous eye blink rates. Experimental brain research, 196:467–474, 2009. 2

  17. [25]

    Scanmatch: A novel method for comparing fixation sequences

    Filipe Cristino, Sebastiaan Math ˆot, Jan Theeuwes, and Iain D Gilchrist. Scanmatch: A novel method for comparing fixation sequences. Behavior research methods, 42:692–700, 2010. 7

  18. [26]

    Maximum expected hitting cost of a markov decision process and informativeness of rewards

    Falcon Dai and Matthew Walter. Maximum expected hitting cost of a markov decision process and informativeness of rewards. Advances in Neural Information Processing Systems, 32, 2019. 3

  19. [27]

    Scanpathnet: A recurrent mixture density network for scanpath prediction

    Ryan Anthony Jalova de Belen, Tomasz Bednarz, and Arcot Sowmya. Scanpathnet: A recurrent mixture density network for scanpath prediction. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5010–5020, 2022. 2

  20. [28]

    Imagenet: A large-scale hierarchical image database

    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pages 248–255. Ieee, 2009. 4

  21. [29]

    Exploration-guided reward shaping for reinforcement learning under sparse rewards

    Rati Devidze, Parameswaran Kamalaruban, and Adish Singla. Exploration-guided reward shaping for reinforcement learning under sparse rewards. Advances in Neural Information Processing Systems , 35:5829–5842,

  22. [30]

    How does the brain solve visual object recognition? Neuron, 73(3):415–434, 2012

    James J DiCarlo, Davide Zoccolan, and Nicole C Rust. How does the brain solve visual object recognition? Neuron, 73(3):415–434, 2012. 2

  23. [31]

    Efficient zero-shot visual search via target and context-aware transformer

    Zhiwei Ding, Xuezhe Ren, Erwan David, Melissa V o, Gabriel Kreiman, and Mengmi Zhang. Efficient zero-shot visual search via target and context-aware transformer. arXiv preprint arXiv:2211.13470, 2022. 2

  24. [32]

    Prioritizing selection of new elements: Bottom-up versus top-down control

    Mieke Donk and Jan Theeuwes. Prioritizing selection of new elements: Bottom-up versus top-down control. Perception & psychophysics, 65:1231–1242, 2003. 2

  25. [33]

    An image is worth 16x16 words: Transformers for image recognition at scale

    Alexey Dosovitskiy. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020. 4, 5

  26. [34]

    Searching for conjunctively defined targets

    Howard E Egeth, Robert A Virzi, and Hadley Garbart. Searching for conjunctively defined targets. Journal of Experimental Psychology: Human Perception and Performance, 10(1):32, 1984. 2

  27. [35]

    When is it time to move to the next map? optimal foraging in guided visual search

    Krista A Ehinger and Jeremy M Wolfe. When is it time to move to the next map? optimal foraging in guided visual search. Attention, Perception, & Psychophysics, 78: 2135–2151, 2016. 2

  28. [36]

    Spatial statistics and attentional dynamics in scene viewing

    Ralf Engbert, Hans A Trukenbrod, Simon Barthelm ´e, and Felix A Wichmann. Spatial statistics and attentional dynamics in scene viewing. Journal of vision, 15(1):14–14,

  29. [37]

    Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures

    Lasse Espeholt, Hubert Soyer, Remi Munos, Karen Simonyan, Vlad Mnih, Tom Ward, Yotam Doron, Vlad Firoiu, Tim Harley, Iain Dunning, et al. Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures. In International conference on machine learning,...

  30. [38]

    The antisaccade task in a sample of 2,006 young men: I

    I Evdokimidis, N Smyrnis, Theodoros Constantinidis, N Stefanis, D Avramopoulos, C Paximadis, C Theleritis, C Efstratiadis, G Kastrinakis, and C Stefanis. The antisaccade task in a sample of 2,006 young men: I. normal population characteristics. Experimental Brain Research, 147:45–52,

  31. [39]

    Contrastive learning as goal-conditioned reinforcement learning

    Benjamin Eysenbach, Tianjun Zhang, Sergey Levine, and Russ R Salakhutdinov. Contrastive learning as goal-conditioned reinforcement learning. Advances in Neural Information Processing Systems, 35:35603–35620,

  32. [40]

    Oat: Object-level attention transformer for gaze scanpath prediction

    Yini Fang, Jingling Yu, Haozheng Zhang, Ralf van der Lans, and Bertram Shi. Oat: Object-level attention transformer for gaze scanpath prediction. In European Conference on Computer Vision, pages 366–382. Springer,

  33. [41]

    On the development of voluntary and reflexive components in human saccade generation

    Burkhart Fischer, Monica Biscaldi, and Stefan Gezeck. On the development of voluntary and reflexive components in human saccade generation. Brain research, 754(1-2): 285–297, 1997. 2

  34. [42]

    Smooth pursuit eye movements of patients with schizophrenia and affective disorder during clinical treatment

    Klaus-Malte Flechtner, Bruno Steinacher, Robert Sauer, and Arthur Mackert. Smooth pursuit eye movements of patients with schizophrenia and affective disorder during clinical treatment. European archives of psychiatry and clinical neuroscience, 252:49–53, 2002. 2

  35. [43]

    Decoding go/no-go decisions from eye movements

    Jolande Fooken and Miriam Spering. Decoding go/no-go decisions from eye movements. Journal of vision , 19(2): 5–5, 2019. 2

  36. [44]

    What can saliency models predict about eye movements? spatial and sequential aspects of fixations during encoding and recognition

    Tom Foulsham and Geoffrey Underwood. What can saliency models predict about eye movements? spatial and sequential aspects of fixations during encoding and recognition. Journal of vision, 8(2):6–6, 2008. 2

  37. [45]

    Metamers of the ventral stream

    Jeremy Freeman and Eero P Simoncelli. Metamers of the ventral stream. Nature neuroscience , 14(9):1195–1201,

  38. [46]

    Eye movement monitoring as a process tracing methodology in decision making research

    Mackenzie G Glaholt and Eyal M Reingold. Eye movement monitoring as a process tracing methodology in decision making research. Journal of Neuroscience, Psychology, and Economics, 4(2):125, 2011. 2

  39. [47]

    Value-based attention but not divisive normalization influences decisions with multiple alternatives

    Sebastian Gluth, Nadja Kern, Maria Kortmann, and C´ecile L Vitali. Value-based attention but not divisive normalization influences decisions with multiple alternatives. Nature human behaviour , 4(6):634–645,

  40. [48]

    Microsaccade production during saccade cancelation in a stop-signal task

    David C Godlove and Jeffrey D Schall. Microsaccade production during saccade cancelation in a stop-signal task. Vision research, 118:5–16, 2016. 2

  41. [49]

    A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception

    Alexander Goettker and Karl R Gegenfurtner. A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception. Vision Research, 188:283–296, 2021. 2

  42. [50]

    Reconstructing human gaze behavior from eeg using inverse reinforcement learning

    Jiaqi Gong, Shengting Cao, Soroush Korivand, and Nader Jalili. Reconstructing human gaze behavior from eeg using inverse reinforcement learning. Smart Health, 32:100480,

  43. [51]

    Visual search asymmetry: Deep nets and humans share similar inherent biases

    Shashi Kant Gupta, Mengmi Zhang, Chia-Chien Wu, Jeremy Wolfe, and Gabriel Kreiman. Visual search asymmetry: Deep nets and humans share similar inherent biases. Advances in neural information processing systems, 34:6946–6959, 2021. 2, 4, 8, 1

  44. [52]

    Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor

    Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on machine learning , pages 1861–1870. PMLR, 2018. 2

  45. [53]

    The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas v4, it for attention and eye movement

    Fred H Hamker. The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas v4, it for attention and eye movement. Cerebral cortex, 15(4):431–447, 2005. 7

  46. [54]

    Stabilizing deep q-learning with convnets and vision transformers under data augmentation

    Nicklas Hansen, Hao Su, and Xiaolong Wang. Stabilizing deep q-learning with convnets and vision transformers under data augmentation. Advances in neural information processing systems, 34:3680–3693, 2021. 3

  47. [55]

    Hierarchical world models as visual whole-body humanoid controllers

    Nicklas Hansen, Jyothir SV , Vlad Sobal, Yann LeCun, Xiaolong Wang, and Hao Su. Hierarchical world models as visual whole-body humanoid controllers. arXiv preprint arXiv:2405.18418, 2024. 3

  48. [56]

    Monte carlo sampling methods using markov chains and their applications

    W Keith Hastings. Monte carlo sampling methods using markov chains and their applications. 1970. 2

  49. [57]

    Object identification in context: the visual processing of natural scenes

    John M Henderson. Object identification in context: the visual processing of natural scenes. Canadian Journal of Psychology/Revue canadienne de psychologie , 46(3):319,

  50. [58]

    Eliminating inhibition of return by changing salient nonspatial attributes in a complex environment

    Frank K Hu, Arthur G Samuel, and Agnes S Chan. Eliminating inhibition of return by changing salient nonspatial attributes in a complex environment. Journal of Experimental Psychology: General, 140(1):35, 2011. 6

  51. [59]

    Learning to reason: End-to-end module networks for visual question answering

    Ronghang Hu, Jacob Andreas, Marcus Rohrbach, Trevor Darrell, and Kate Saenko. Learning to reason: End-to-end module networks for visual question answering. In Proceedings of the IEEE international conference on computer vision, pages 804–813, 2017. 2

  52. [60]

    A saliency-based search mechanism for overt and covert shifts of visual attention

    Laurent Itti and Christof Koch. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision research, 40(10-12):1489–1506, 2000. 2

  53. [61]

    Fantastic answers and where to find them: Immersive question-directed visual attention

    Ming Jiang, Shi Chen, Jinhui Yang, and Qi Zhao. Fantastic answers and where to find them: Immersive question-directed visual attention. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2980–2989, 2020. 2

  54. [62]

    Decision-related perturbations of decision-irrelevant eye movements

    Sung Jun Joo, Leor N Katz, and Alexander C Huk. Decision-related perturbations of decision-irrelevant eye movements. Proceedings of the National Academy of Sciences, 113(7):1925–1930, 2016. 2

  55. [63]

    Differentiating between models of perceptual decision making using pupil size inferred confidence

    Katsuhisa Kawaguchi, Stephane Clery, Paria Pourriahi, Lenka Seillier, Ralf M Haefner, and Hendrikje Nienborg. Differentiating between models of perceptual decision making using pupil size inferred confidence. Journal of Neuroscience, 38(41):8874–8888, 2018. 2

  56. [64]

    Adam: A method for stochastic optimization

    Diederik P Kingma. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014. 5

  57. [65]

    Canceling of pursuit and saccadic eye movements in humans and monkeys

    Krista Kornylo, Natalie Dill, Melissa Saenz, and Richard J Krauzlis. Canceling of pursuit and saccadic eye movements in humans and monkeys. Journal of Neurophysiology, 89 (6):2984–2999, 2003. 2

  58. [66]

    A closed curve is much more than an incomplete one: effect of closure in figure-ground segmentation

    Ilona Kovacs and Bela Julesz. A closed curve is much more than an incomplete one: effect of closure in figure-ground segmentation. Proceedings of the National Academy of Sciences, 90(16):7495–7497, 1993. 2

  59. [67]

    Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions

    Ian Krajbich and Antonio Rangel. Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions. Proceedings of the National Academy of Sciences, 108(33): 13852–13857, 2011. 2

  60. [68]

    Visual fixations and the computation and comparison of value in simple choice

    Ian Krajbich, Carrie Armel, and Antonio Rangel. Visual fixations and the computation and comparison of value in simple choice. Nature neuroscience, 13(10):1292–1298,

  61. [69]

    The control of voluntary eye movements: new perspectives

    Richard J Krauzlis. The control of voluntary eye movements: new perspectives. The Neuroscientist, 11(2): 124–137, 2005. 2

  62. [70]

    Priming in visual search: Separating the effects of target repetition, distractor repetition and role-reversal

    ´Arni Kristj ´ansson and Jon Driver. Priming in visual search: Separating the effects of target repetition, distractor repetition and role-reversal. Vision Research , 48(10): 1217–1232, 2008. 2

  63. [71]

    Current perspectives in medical image perception

    Elizabeth A Krupinski. Current perspectives in medical image perception. Attention, Perception, & Psychophysics, 72(5):1205–1217, 2010. 2

  64. [72]

    The influence of reward on the speed of reinforcement learning: An analysis of shaping

    Adam Laud and Gerald DeJong. The influence of reward on the speed of reinforcement learning: An analysis of shaping. In Proceedings of the 20th International Conference on Machine Learning (ICML-03) , pages 440–447, 2003. 3

  65. [73]

    Cqm: Curriculum reinforcement learning with a quantized world model

    Seungjae Lee, Daesol Cho, Jonghae Park, and H Jin Kim. Cqm: Curriculum reinforcement learning with a quantized world model. Advances in Neural Information Processing Systems, 36:78824–78845, 2023. 6

  66. [74]

    Hierarchical bayesian inference in the visual cortex

    Tai Sing Lee and David Mumford. Hierarchical bayesian inference in the visual cortex. JOSA a, 20(7):1434–1448,

  67. [75]

    The neurology of eye movements

    R John Leigh and David S Zee. The neurology of eye movements. Oxford University Press, USA, 2015. 2

  68. [76]

    Schizophrenia spectrum disorders and eye tracking dysfunction in singleton and multiplex schizophrenia families

    Rebekka Lencer, Katja Trillenberg-Krecker, Eberhard Schwinger, and V olker Arolt. Schizophrenia spectrum disorders and eye tracking dysfunction in singleton and multiplex schizophrenia families. Schizophrenia Research, 60(1):33–45, 2003. 2

  69. [77]

    Global and local covert visual attention: Evidence from a bayesian hidden markov model

    John Liechty, Rik Pieters, and Michel Wedel. Global and local covert visual attention: Evidence from a bayesian hidden markov model. Psychometrika, 68:519–541, 2003. 2

  70. [78]

    Evidence accumulation for value computation in the prefrontal cortex during decision making

    Zhongqiao Lin, Chechang Nie, Yuanfeng Zhang, Yang Chen, and Tianming Yang. Evidence accumulation for value computation in the prefrontal cortex during decision making. Proceedings of the National Academy of Sciences, 117(48):30728–30737, 2020. 2

  71. [79]

    Visual guidance of smooth pursuit eye movements

    Stephen G Lisberger. Visual guidance of smooth pursuit eye movements. Annual review of vision science, 1(1):447–468,

  72. [80]

    The impact of risk and prevalence on foraging behavior in hybrid visual search

    Yanjun Liu, Jeremy M Wolfe, and Jennifer Trueblood. The impact of risk and prevalence on foraging behavior in hybrid visual search. In Proceedings of the Annual Meeting of the Cognitive Science Society, 2023. 2

  73. [81]

    Large language models play starcraft ii: Benchmarks and a chain of summarization approach

    Weiyu Ma, Qirui Mi, Xue Yan, Yuqiao Wu, Runji Lin, Haifeng Zhang, and Jun Wang. Large language models play starcraft ii: Benchmarks and a chain of summarization approach. arXiv preprint arXiv:2312.11865, 2023. 3

  74. [82]

    Irrelevant reward and selection histories have different influences on task-relevant attentional selection

    Mary H MacLean and Barry Giesbrecht. Irrelevant reward and selection histories have different influences on task-relevant attentional selection. Attention, Perception, & Psychophysics, 77:1515–1528, 2015. 2

  75. [83]

    Resource management with deep reinforcement learning

    Hongzi Mao, Mohammad Alizadeh, Ishai Menache, and Srikanth Kandula. Resource management with deep reinforcement learning. In Proceedings of the 15th ACM workshop on hot topics in networks, pages 50–56, 2016. 3

  76. [84]

    Feature-based attention in visual cortex

    John HR Maunsell and Stefan Treue. Feature-based attention in visual cortex. Trends in neurosciences, 29(6): 317–322, 2006. 2

  77. [85]

    Saccadic eye movements as an index of perceptual decision-making

    Eugene McSorley and Rachel McCloy. Saccadic eye movements as an index of perceptual decision-making. Experimental brain research, 198:513–520, 2009. 2

  78. [86]

    There’s waldo! a normalization model of visual search predicts single-trial human fixations in an object search task

    Thomas Miconi, Laura Groomes, and Gabriel Kreiman. There’s waldo! a normalization model of visual search predicts single-trial human fixations in an object search task. Cerebral cortex, 26(7):3064–3082, 2015. 2, 7

  79. [87]

    The roles of the lateral intraparietal area and frontal eye field in guiding eye movements in free viewing search behavior

    Koorosh Mirpour and James W Bisley. The roles of the lateral intraparietal area and frontal eye field in guiding eye movements in free viewing search behavior. Journal of Neurophysiology, 2021. 2

  80. [88]

    Stopping smooth pursuit

    Marcus Missal and Stephen J Heinen. Stopping smooth pursuit. Philosophical Transactions of the Royal Society B: Biological Sciences, 372(1718):20160200, 2017. 2

  81. [89]

    Playing atari with deep reinforcement learning

    V olodymyr Mnih. Playing atari with deep reinforcement learning. arXiv preprint arXiv:1312.5602, 2013. 3

  82. [90]

    Asynchronous methods for deep reinforcement learning

    V olodymyr Mnih. Asynchronous methods for deep reinforcement learning. arXiv preprint arXiv:1602.01783,

  83. [91]

    Recurrent models of visual attention

    V olodymyr Mnih, Nicolas Heess, Alex Graves, et al. Recurrent models of visual attention. Advances in neural information processing systems, 27, 2014. 2

  84. [92]

    Human-level control through deep reinforcement learning

    V olodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski, et al. Human-level control through deep reinforcement learning. nature, 518(7540):529–533, 2015. 2, 6, 3

  85. [93]

    Gazeformer: Scalable, effective and fast prediction of goal-directed human attention

    Sounak Mondal, Zhibo Yang, Seoyoung Ahn, Dimitris Samaras, Gregory Zelinsky, and Minh Hoai. Gazeformer: Scalable, effective and fast prediction of goal-directed human attention. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 1441–1...

  86. [94]

    Does attention increase the value of choice alternatives? Trends in cognitive sciences, 25(4):305–315, 2021

    Milica Mormann and J Edward Russo. Does attention increase the value of choice alternatives? Trends in cognitive sciences, 25(4):305–315, 2021. 2

  87. [95]

    Saccade, search and orient–the neural control of saccadic eye movements, 2011

    Douglas P Munoz and Brian C Coe. Saccade, search and orient–the neural control of saccadic eye movements, 2011. 2

  88. [96]

    Adaptive circuit dynamics across human cortex during evidence accumulation in changing environments

    Peter R Murphy, Niklas Wilming, Diana C Hernandez-Bocanegra, Genis Prat-Ortega, and Tobias H Donner. Adaptive circuit dynamics across human cortex during evidence accumulation in changing environments. Nature neuroscience, 24(7):987–997, 2021. 2

  89. [97]

    Curriculum learning in reinforcement learning

    Sanmit Narvekar. Curriculum learning in reinforcement learning. In IJCAI, pages 5195–5196, 2017. 6

  90. [98]

    Curriculum learning for reinforcement learning domains: A framework and survey

    Sanmit Narvekar, Bei Peng, Matteo Leonetti, Jivko Sinapov, Matthew E Taylor, and Peter Stone. Curriculum learning for reinforcement learning domains: A framework and survey. Journal of Machine Learning Research , 21 (181):1–50, 2020. 6

  91. [99]

    Adaglimpse: Active visual exploration with arbitrary glimpse position and scale

    Adam Pardyl, Michał Wronka, Maciej Wołczyk, Kamil Adamczewski, Tomasz Trzci ´nski, and Bartosz Zieli´nski. Adaglimpse: Active visual exploration with arbitrary glimpse position and scale. arXiv preprint arXiv:2404.03482, 2024. 2, 3

  92. [100]

    Optimal foraging: L ´evy pattern or process? Journal of the Royal Society Interface , 5(26): 1077–1086, 2008

    MJ Plank and A James. Optimal foraging: L ´evy pattern or process? Journal of the Royal Society Interface , 5(26): 1077–1086, 2008. 2

  93. [101]

    A quantitative analysis of saccades and smooth pursuit during visual pursuit tracking: A comparison of schizophrenics with normals and substance abusing controls

    Allen D Radant and Daniel W Hommer. A quantitative analysis of saccades and smooth pursuit during visual pursuit tracking: A comparison of schizophrenics with normals and substance abusing controls. Schizophrenia research, 6(3):225–235, 1992. 2

  94. [102]

    Direct preference optimization: Your language model is secretly a reward model

    Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. Direct preference optimization: Your language model is secretly a reward model. Advances in Neural Information Processing Systems, 36, 2024. 2

  95. [103]

    Microsaccades: small steps on a long way

    Martin Rolfs. Microsaccades: small steps on a long way. Vision research, 49(20):2415–2441, 2009. 2

  96. [104]

    Which duration of postsaccadic slowing identifies anticipatory saccades during smooth pursuit eye movements? Psychophysiology, 38(2):325–333, 2001

    Randal G Ross, Ann Olincy, Gary Zerbe, and Allen Radant. Which duration of postsaccadic slowing identifies anticipatory saccades during smooth pursuit eye movements? Psychophysiology, 38(2):325–333, 2001. 2

  97. [105]

    Human oculomotor function: reliability and diurnal variation

    Peter Roy-Byrne, Allen Radant, Dane Wingerson, and Deborah S Cowley. Human oculomotor function: reliability and diurnal variation. Biological Psychiatry, 38(2):92–97,

  98. [106]

    Post-capture processes contribute to statistical learning of distractor locations in visual search

    Marian Sauter, Nina M Hanning, Heinrich R Liesefeld, and Hermann J M ¨uller. Post-capture processes contribute to statistical learning of distractor locations in visual search. Cortex, 135:108–126, 2021. 2

  99. [107]

    Habitat: A platform for embodied ai research

    Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, et al. Habitat: A platform for embodied ai research. In Proceedings of the IEEE/CVF international conference on computer vision ,...

  100. [108]

    High-dimensional continuous control using generalized advantage estimation

    John Schulman, Philipp Moritz, Sergey Levine, Michael Jordan, and Pieter Abbeel. High-dimensional continuous control using generalized advantage estimation. arXiv preprint arXiv:1506.02438, 2015. 2, 3

  101. [109]

    Proximal policy optimization algorithms

    John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017. 2, 5

  102. [110]

    Saccade metrics reflect decision-making dynamics during urgent choices

    Joshua A Seideman, Terrence R Stanford, and Emilio Salinas. Saccade metrics reflect decision-making dynamics during urgent choices. Nature communications, 9(1):2907,

  103. [111]

    Masked world models for visual control

    Younggyo Seo, Danijar Hafner, Hao Liu, Fangchen Liu, Stephen James, Kimin Lee, and Pieter Abbeel. Masked world models for visual control. In Conference on Robot Learning, pages 1332–1344. PMLR, 2023. 3

  104. [112]

    Movement vigor as a reflection of subjective economic utility

    Reza Shadmehr, Thomas R Reppert, Erik M Summerside, Tehrim Yoon, and Alaa A Ahmed. Movement vigor as a reflection of subjective economic utility. Trends in neurosciences, 42(5):323–336, 2019. 2

  105. [113]

    Mastering the game of go with deep neural networks and tree search

    David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al. Mastering the game of go with deep neural networks and tree search. nature, 529(7587): 484–489, 2016. 3

  106. [114]

    Very deep convolutional networks for large-scale image recognition

    Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014. 4

  107. [115]

    Does oculomotor inhibition of return influence fixation probability during scene search? Attention, Perception, & Psychophysics, 73: 2384–2398, 2011

    Tim J Smith and John M Henderson. Does oculomotor inhibition of return influence fixation probability during scene search? Attention, Perception, & Psychophysics, 73: 2384–2398, 2011. 6

  108. [116]

    The antisaccade task in a sample of 2,006 young males: Ii

    N Smyrnis, I Evdokimidis, N Stefanis, T Constantinidis, D Avramopoulos, C Theleritis, C Paximadis, C Efstratiadis, G Kastrinakis, and C Stefanis. The antisaccade task in a sample of 2,006 young males: Ii. effects of task parameters. Experimental brain research, 147:53–63, 2002. 2

  109. [117]

    What the brain stem tells the frontal cortex

    Marc A Sommer and Robert H Wurtz. What the brain stem tells the frontal cortex. i. oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamus. Journal of neurophysiology , 91(3):1381–1402,

  110. [118]

    Proactive information sampling in value-based decision-making: Deciding when and where to saccade

    Mingyu Song, Xingyu Wang, Hang Zhang, and Jian Li. Proactive information sampling in value-based decision-making: Deciding when and where to saccade. Frontiers in human neuroscience, 13:35, 2019. 2

  111. [119]

    Eye movements as a window into decision-making

    Miriam Spering. Eye movements as a window into decision-making. Annual review of vision science , 8(1): 427–448, 2022. 2

  112. [120]

    Urgent decision making: resolving visuomotor interactions at high temporal resolution

    Terrence R Stanford and Emilio Salinas. Urgent decision making: resolving visuomotor interactions at high temporal resolution. Annual Review of Vision Science, 7(1):323–348,

  113. [121]

    A satisficing choice model

    Peter St ¨uttgen, Peter Boatwright, and Robert T Monroe. A satisficing choice model. Marketing Science , 31(6): 878–899, 2012. 2

  114. [122]

    Scandmm: A deep markov model of scanpath prediction for 360deg images

    Xiangjie Sui, Yuming Fang, Hanwei Zhu, Shiqi Wang, and Zhou Wang. Scandmm: A deep markov model of scanpath prediction for 360deg images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6989–6999, 2023. 2

  115. [123]

    Attention in natural scenes: contrast affects rapid visual processing and fixations alike

    Bernard Marius ’t Hart, Hannah Claudia Elfriede Fanny Schmidt, Ingo Klein-Harmeyer, and Wolfgang Einh ¨auser. Attention in natural scenes: contrast affects rapid visual processing and fixations alike. Philosophical Transactions of the Royal Society B: Biological Sciences , 368...

  116. [124]

    Processing feature density in preattentive perception

    Steven Taylor and David Badcock. Processing feature density in preattentive perception. Perception & psychophysics, 44:551–562, 1988. 2

  117. [125]

    Context-dependent urgency influences speed–accuracy trade-offs in decision-making and movement execution

    David Thura, Ignasi Cos, Jessica Trung, and Paul Cisek. Context-dependent urgency influences speed–accuracy trade-offs in decision-making and movement execution. Journal of Neuroscience, 34(49):16442–16454, 2014. 2

  118. [126]

    head and eye movements and gaze tracking in baseball batting.Optometry and Vision Science, 98(7):750–758, 2021

    Andrew J Toole and Nick Fogt. head and eye movements and gaze tracking in baseball batting.Optometry and Vision Science, 98(7):750–758, 2021. 2

  119. [127]

    Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search.Psychological review, 113(4):766,

    Antonio Torralba, Aude Oliva, Monica S Castelhano, and John M Henderson. Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search.Psychological review, 113(4):766,

  120. [128]

    Simultaneous modeling of visual saliency and value computation improves predictions of economic choice

    R Blythe Towal, Milica Mormann, and Christof Koch. Simultaneous modeling of visual saliency and value computation improves predictions of economic choice. Proceedings of the National Academy of Sciences, 110(40): E3858–E3867, 2013. 2

  121. [129]

    Eye-movement analysis of search effectiveness

    Ralf Van der Lans, Rik Pieters, and Michel Wedel. Eye-movement analysis of search effectiveness. Journal of the American Statistical Association, 103(482):452–461,

  122. [130]

    Comparing object recognition in humans and deep convolutional neural networks—an eye tracking study

    Leonard Elia Van Dyck, Roland Kwitt, Sebastian Jochen Denzler, and Walter Roland Gruber. Comparing object recognition in humans and deep convolutional neural networks—an eye tracking study. Frontiers in Neuroscience, 15:750639, 2021. 2

  123. [131]

    Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning

    Joanne C Van Slooten, Sara Jahfari, and Jan Theeuwes. Spontaneous eye blink rate predicts individual differences in exploration and exploitation during reinforcement learning. Scientific reports, 9(1):17436, 2019. 2

  124. [132]

    Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects

    Derrick G Watson and Glyn W Humphreys. Visual marking: prioritizing selection for new objects by top-down attentional inhibition of old objects. Psychological review, 104(1):90, 1997. 2

  125. [133]

    Guided search 5.0: Meeting the challenge of hybrid search and multiple-target foraging

    Jeremy Wolfe, Matthew Cain, Krista Ehinger, and Trafton Drew. Guided search 5.0: Meeting the challenge of hybrid search and multiple-target foraging. Journal of vision, 15 (12):1106–1106, 2015. 2

  126. [134]

    Saved by a log: How do humans perform hybrid visual and memory search? Psychological Science, 23(7):698–703, 2012

    Jeremy M Wolfe. Saved by a log: How do humans perform hybrid visual and memory search? Psychological Science, 23(7):698–703, 2012. 7

  127. [135]

    Do intersections serve as basic features in visual search? Perception, 32(6): 645–656, 2003

    Jeremy M Wolfe and Jennifer S DiMase. Do intersections serve as basic features in visual search? Perception, 32(6): 645–656, 2003. 2

  128. [136]

    Five factors that guide attention in visual search

    Jeremy M Wolfe and Todd S Horowitz. Five factors that guide attention in visual search. Nature human behaviour, 1(3):0058, 2017. 2

  129. [137]

    Hybrid foraging search: Searching for multiple instances of multiple types of target

    Jeremy M Wolfe, Avigael M Aizenman, Sage EP Boettcher, and Matthew S Cain. Hybrid foraging search: Searching for multiple instances of multiple types of target. Vision research, 119:50–59, 2016. 2

  130. [138]

    Hybrid value foraging: How the value of targets shapes human foraging behavior

    Jeremy M Wolfe, Matthew S Cain, and Abla Alaoui-Soce. Hybrid value foraging: How the value of targets shapes human foraging behavior. Attention, Perception, & Psychophysics, 80:609–621, 2018. 3, 8

  131. [139]

    Guidance and selection history in hybrid foraging visual search

    Jeremy M Wolfe, Matthew S Cain, and Avigael M Aizenman. Guidance and selection history in hybrid foraging visual search. Attention, Perception, & Psychophysics, 81:637–653, 2019. 2

  132. [140]

    Eye movements in medical image perception: a selective review of past, present and future

    Chia-Chien Wu and Jeremy M Wolfe. Eye movements in medical image perception: a selective review of past, present and future. Vision, 3(2):32, 2019. 2

  133. [141]

    Predicting goal-directed human attention using inverse reinforcement learning

    Zhibo Yang, Lihan Huang, Yupei Chen, Zijun Wei, Seoyoung Ahn, Gregory Zelinsky, Dimitris Samaras, and Minh Hoai. Predicting goal-directed human attention using inverse reinforcement learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition,...

  134. [142]

    Unifying top-down and bottom-up scanpath prediction using transformers

    Zhibo Yang, Sounak Mondal, Seoyoung Ahn, Ruoyu Xue, Gregory Zelinsky, Minh Hoai, and Dimitris Samaras. Unifying top-down and bottom-up scanpath prediction using transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 1683–1693...

  135. [143]

    Control of movement vigor and decision making during foraging

    Tehrim Yoon, Robert B Geary, Alaa A Ahmed, and Reza Shadmehr. Control of movement vigor and decision making during foraging. Proceedings of the National Academy of Sciences, 115(44):E10476–E10485, 2018. 2

  136. [144]

    How humans react to changing rewards during visual foraging

    Jinxia Zhang, Xue Gong, Daryl Fougnie, and Jeremy M Wolfe. How humans react to changing rewards during visual foraging. Attention, Perception, & Psychophysics , 79:2299–2309, 2017. 2

  137. [145]

    Finding any waldo with zero-shot invariant and efficient visual search

    Mengmi Zhang, Jiashi Feng, Keng Teck Ma, Joo Hwee Lim, Qi Zhao, and Gabriel Kreiman. Finding any waldo with zero-shot invariant and efficient visual search. Nature communications, 9(1):3730, 2018. 2, 4, 6

  138. [146]

    Look twice: A generalist computational model predicts return fixations across tasks and species

    Mengmi Zhang, Marcelo Armendariz, Will Xiao, Olivia Rose, Katarina Bendtz, Margaret Livingstone, Carlos Ponce, and Gabriel Kreiman. Look twice: A generalist computational model predicts return fixations across tasks and species. PLoS computational biology , 18(11): e1010654, 2...

  139. [147]

    Deep reinforcement learning-based methods for resource scheduling in cloud computing: A review and future directions

    Guangyao Zhou, Wenhong Tian, Rajkumar Buyya, Ruini Xue, and Liang Song. Deep reinforcement learning-based methods for resource scheduling in cloud computing: A review and future directions. Artificial Intelligence Review, 57(5):124, 2024. 3 Supplementary Material for Gazing at...

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.