Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-16T10:14:06.354960Z
Paper Citation Record · LEDGER
As of 18 August 2026, this Paper Citation Record lists 47 of 47 outbound references and 0 inbound Pith citation observations for arXiv:2504.18794.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-16T10:14:06.354960Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
47 of 47 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 6725a17d-cac4-4f75-bc51-7d457ba343cf · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Maximum a Posteriori Policy Optimisation
Reference 1
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 5240400f-ebdb-493a-85c7-36592fc1880b · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Hindsight Experience Replay
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6ce205ca-28bf-4aa9-80a8-dc3918f23df5 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots The Option-Critic Architecture
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 596f85c3-0ed6-4b70-8ec6-594e560b1062 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Option Discovery using Deep Skill Chaining
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 517485e4-c931-4c9f-b355-816676ce2209 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Unresolved cited work
Reference 5
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation fea78c63-470e-4df4-805d-7c2ce6db5a9f · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots FAIRIS: Framework for Autonomous Intelligent Robotic Interaction and Simulation
Reference 6
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 6dca1e1f-caae-4784-9dfb-a5a601b7378a · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Reservoir computing model of prefrontal cortex creates novel combinations of previous navigation sequences from hip- pocampal place-cell replay with spatial reward propagation
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 66303e1b-fa5a-4e54-b6a6-3addd23b1efd · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Attention Option-Critic
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 331f04d6-c64e-441e-8584-260efda6c388 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Feudal Reinforcement Learn- ing
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 9a7e089a-4f6b-4e2c-9647-30c97a9d3ea2 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation fe52a4cd-cf2f-4eec-bd82-512563f13a89 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Implementation Matters in Deep RL: A Case Study on PPO and TRPO
Reference 11
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 2b28c5dc-f49e-4009-bd0d-89239c690a20 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Reverse Curriculum Generation for Reinforcement Learning
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c121ca03-81ae-4f9c-9762-4055f8764df0 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 423903b5-1766-4bbf-8045-80d5c83b6708 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots The Termination Critic
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c91f4904-69d5-4e89-8d78-e8b6a28d78c6 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Double Q-learning
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 27adccd6-b5e7-4a6a-b037-fb2a0419e573 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Options of Interest: Temporal Abstraction with Interest Functions
Reference 16
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 42864449-d36a-470f-8471-6ed6dea4c00d · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Learnings Options End-to-End for Continuous Action Tasks
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ec965bf9-204d-493f-b22f-3c1a886c56a1 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Actor-Critic Algorithms
Reference 18
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 841c8b3b-1c90-4b94-920b-308a1d6a43af · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Skill Discovery in Continuous ReinforcementLearningDomainsusingSkillChaining
Reference 19
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation d89f4a19-6a64-4339-864a-431fe0b0ae4e · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots UAV Trajectory Optimization for Spectrum Cartogra- phy: A PPO Approach
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 6e33ab6b-cc4e-4e8e-b31b-a8be883ab559 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Continuous control with deep reinforcement learning
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation af93faab-59eb-42f4-8910-3f9bed929ab1 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Automatic Discovery of Sub- goals in Reinforcement Learning using Diverse Density
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 16947b6e-b6fc-4bc6-b16d-ffb6b69ae7a3 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots A Place Cell Model for Spatio-Temporal Navigation Learning with LSTM
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0321b58a-eb40-46fe-b641-551a9ab9fc52 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Q-Cut—Dynamic Discovery of Sub-goals in Reinforcement Learning
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 72f032a0-577c-4a5e-9367-3a1db2d3abdf · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Asynchronous Methods for Deep Reinforcement Learning
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 90a9c514-a67b-4454-a7df-33deac6d7fd4 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Human-level control through deep reinforce- ment learning
Reference 26
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 2c2dfdd9-a4ee-42a8-9474-a7526d74a121 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Unresolved cited work
Reference 27
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation fcddf38a-dbb8-477b-94fe-3c4062320186 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Why Does Hierarchy (Sometimes) Work So Well in Reinforcement Learning?
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 779b735a-1c88-4ea9-9765-241e2ecd6b9c · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Rectified linear units improve restricted boltzmann machines
Reference 29
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 8b0befd2-9f6a-4911-8168-df72176d1b89 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Unresolved cited work
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 1ea961e1-d44d-4fc8-8794-5609ecfe4c2c · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Data-Efficient Hierarchical Reinforcement Learning
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6deb098a-b7fd-4403-8e49-29e3719aaf8b · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Hindsight policy gradients
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b5a702e7-1e4a-419c-9d08-d43236add94a · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Comparative Analysis of A3C and PPO Algorithms in Reinforcement Learning: A SurveyonGeneralEnvironments
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8915722d-bc70-4c35-a6b3-ef1c1cc15ea6 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Proximal Policy Optimization Algorithms
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3a6ad40f-a2fb-4dc6-bbb1-92e9b0e43051 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Trust Region Policy Optimization
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7952c4dc-f653-4a10-92a6-221ad1e45ec3 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Hierarchical Reinforcement Learning: A Com- prehensive Survey
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation befbebda-630b-4f9f-8ae3-97f08b07a671 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Optimizing Autonomous Driving with Advanced Reinforcement Learning: Evaluating DQN and PPO
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e2a58e2b-5f68-4026-8079-0ed3c2ebb773 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Optimizing Autonomous Vehi- cle Navigation with DQN and PPO: A Reinforcement Learning Ap- proach
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 282501ce-50b9-4c02-b428-fcf7ca7a034b · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Sutton and Andrew G
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 19dfadaa-2898-4df2-9ed3-6fca729cdd01 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforce- ment learning
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 30b954bc-e8aa-4cad-85e7-2a44d5d9e457 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Integration of velocity-dependent spatio- temporal structure of place cell activation during navigation in a reser- voir model of prefrontal cortex
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 4fa73f28-d5ec-47dd-99d5-908b72b790c2 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots FeUdal Networks for Hierarchical Reinforcement Learning
Reference 42
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 62199170-666a-48b2-a084-e6b100d9f4c5 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Policy Gradient Methods for Reinforcement Learning with Function Approximation
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 54167c48-cbd3-4eb5-9d96-dbf9dc99d517 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Unresolved cited work
Reference 306
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 02c08d37-87f2-432b-9528-56c8b49d409c · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Combining policy gradient and Q-learning
Reference 2017
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 167cbeb5-afbc-4f51-a6a7-a7eda3f8d605 · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots Maximum a Posteriori Policy Optimisation
Reference 2018
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 05b328b3-5c85-426f-b954-48f89d07700a · outbound
Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots url: https://doi.org/10.1038/ nature14236
Reference 4687
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
No inbound Pith citation observations are available.