Paper Citation Record · LEDGER

Exploration by Running Away from the Past

As of 12 August 2026, this Paper Citation Record lists 43 of 43 outbound references and 0 inbound Pith citation observations for arXiv:2411.14085.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.14085 v1

Coverage vector

measured 43 of 43 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T15:40:22.993933Z

measured 43 of 43 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

43 of 43 outbound references displayed

verified exact2
verified fuzzy9
unresolved32
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation bda0ac68-1155-4998-9d0d-b046979b36b5 · outbound

This paper cites Understanding the impact of entropy on policy optimization.

Exploration by Running Away from the Past Understanding the impact of entropy on policy optimization

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.671319Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2aaebc90-2d1e-4992-afb0-189339e19f25 · outbound

This paper cites Logarithmic online regret bounds for undiscounted reinforcement learning.

Exploration by Running Away from the Past Logarithmic online regret bounds for undiscounted reinforcement learning

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.681679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 156b852c-f9c9-4aa6-b4c0-53c03ad72b68 · outbound

This paper cites Never Give Up: Learning Directed Exploration Strategies.

Exploration by Running Away from the Past Never Give Up: Learning Directed Exploration Strategies

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.692471Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97adbe7e-59de-4aba-b7e1-b88de64e1a3e · outbound

This paper cites Unifying count-based exploration and intrinsic motivation.

Exploration by Running Away from the Past Unifying count-based exploration and intrinsic motivation

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.699322Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bfbb4694-67b4-48d2-bbbe-435260879b5b · outbound

This paper cites Tightening exploration in upper confidence reinforcement learning.

Exploration by Running Away from the Past Tightening exploration in upper confidence reinforcement learning

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:24.217540Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 352e47e8-aa12-4e3a-a089-c0924e23141f · outbound

This paper cites R-max-a general polynomial time algorithm for near-optimal reinforcement learning.

Exploration by Running Away from the Past R-max-a general polynomial time algorithm for near-optimal reinforcement learning

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:24.194889Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation cf5f0624-03ce-4d9e-8057-347c88ce7fcb · outbound

This paper cites Openai gym, 2016.

Exploration by Running Away from the Past Openai gym, 2016

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.719361Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e9264c41-c1b6-4e18-8f7b-556c108554e6 · outbound

This paper cites Exploration by Random Network Distillation.

Exploration by Running Away from the Past Exploration by Random Network Distillation

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.725940Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ebeed464-1bb4-4ce0-ba2b-6cf43477017b · outbound

This paper cites Explore, discover and learn: Unsupervised discovery of state-covering skills.

Exploration by Running Away from the Past Explore, discover and learn: Unsupervised discovery of state-covering skills

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:24.144776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation e07adfe4-06e6-4667-a28c-3f7ae357af6a · outbound

This paper cites Gymnasium robotics, 2023.

Exploration by Running Away from the Past Gymnasium robotics, 2023

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:24.118146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 48bb4e06-1fa2-4b2b-855e-895f0cbb78f1 · outbound

This paper cites Adversarial intrinsic motivation for reinforcement learning.

Exploration by Running Away from the Past Adversarial intrinsic motivation for reinforcement learning

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.746176Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b7076def-4eb5-4022-95f7-01dc1bd63f7b · outbound

This paper cites Diversity is All You Need: Learning Skills without a Reward Function.

Exploration by Running Away from the Past Diversity is All You Need: Learning Skills without a Reward Function

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.755343Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf860004-ea3f-4702-b52b-9dd515496c77 · outbound

This paper cites C-Learning: Learning to Achieve Goals via Recursive Classification.

Exploration by Running Away from the Past C-Learning: Learning to Achieve Goals via Recursive Classification

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.764035Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 398a2689-1d68-4d2d-b4f1-b6ed540f17ad · outbound

This paper cites A theory of regularized markov decision processes.

Exploration by Running Away from the Past A theory of regularized markov decision processes

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:24.072675Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 28eebf9b-7734-4f51-81ab-073146859ec2 · outbound

This paper cites Variational Intrinsic Control.

Exploration by Running Away from the Past Variational Intrinsic Control

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.778062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a9ab1715-c75d-41f8-a8da-63e0d6fd77c7 · outbound

This paper cites Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor.

Exploration by Running Away from the Past Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.784544Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a0182ee-2e04-487b-8761-76456bef3f97 · outbound

This paper cites Dynamical Distance Learning for Semi-Supervised and Unsupervised Skill Discovery.

Exploration by Running Away from the Past Dynamical Distance Learning for Semi-Supervised and Unsupervised Skill Discovery

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.791638Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cce507e4-c2be-4db1-9446-2cf17a23dbbf · outbound

This paper cites Provably efficient maximum entropy exploration.

Exploration by Running Away from the Past Provably efficient maximum entropy exploration

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.799039Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5a961092-b5b2-4dd1-99f5-a9b585ea6427 · outbound

This paper cites Reinforcement Learning with Unsupervised Auxiliary Tasks.

Exploration by Running Away from the Past Reinforcement Learning with Unsupervised Auxiliary Tasks

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.806820Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c37f81e9-a6bd-4726-97d1-4e1ff5b61807 · outbound

This paper cites Near-optimal regret bounds for reinforcement learning.

Exploration by Running Away from the Past Near-optimal regret bounds for reinforcement learning

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:23.978194Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation cc3446e3-6e52-4083-90d6-4a328068dd0e · outbound

This paper cites Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments.

Exploration by Running Away from the Past Curiosity in Hindsight: Intrinsic Exploration in Stochastic Environments

Reference 21

Resolution: verified exact; local_arxiv, observed 2026-08-12T15:40:23.441585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 59b4327b-47b6-4cda-9521-2d49a4febf03 · outbound

This paper cites Learning to achieve goals.

Exploration by Running Away from the Past Learning to achieve goals

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.827828Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2ea18cef-fc6a-4454-ae3b-7daedb5bd4f8 · outbound

This paper cites Direct then Diffuse: Incremental Unsupervised Skill Discovery for State Covering and Goal Reaching.

Exploration by Running Away from the Past Direct then Diffuse: Incremental Unsupervised Skill Discovery for State Covering and Goal Reaching

Reference 23

Resolution: verified exact; local_arxiv, observed 2026-08-12T15:40:23.397294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 84a2c8df-3059-4f40-8a48-891b37448f6a · outbound

This paper cites Near-optimal reinforcement learning in polynomial time.

Exploration by Running Away from the Past Near-optimal reinforcement learning in polynomial time

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:23.936279Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 15a55ea9-11cf-4711-a47c-9a6a3559a711 · outbound

This paper cites Efficient Exploration via State Marginal Matching.

Exploration by Running Away from the Past Efficient Exploration via State Marginal Matching

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.849543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e173fc33-67ac-4aa5-bfdf-c62a8e28bc33 · outbound

This paper cites Behavior from the void: Unsupervised active pre-training.

Exploration by Running Away from the Past Behavior from the void: Unsupervised active pre-training

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.857404Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1f650188-b1c2-4f05-aea2-2cbd2c2edcb6 · outbound

This paper cites Playing Atari with Deep Reinforcement Learning.

Exploration by Running Away from the Past Playing Atari with Deep Reinforcement Learning

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.866447Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c47e3dd3-11dd-4116-bbb9-587157d989d3 · outbound

This paper cites From bandits to monte-carlo tree search: The optimistic principle applied to optimization and planning.

Exploration by Running Away from the Past From bandits to monte-carlo tree search: The optimistic principle applied to optimization and planning

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:23.871085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation ce970b08-2dba-43e1-8ed7-d2da2ef7e48a · outbound

This paper cites Lipschitz-constrained unsupervised skill discovery.

Exploration by Running Away from the Past Lipschitz-constrained unsupervised skill discovery

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.879764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97ebaf27-37cc-4660-8241-1614519a0804 · outbound

This paper cites Controllability-Aware Unsupervised Skill Discovery.

Exploration by Running Away from the Past Controllability-Aware Unsupervised Skill Discovery

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.888083Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a183e98b-a7ad-4878-bfcb-ffa433d719b7 · outbound

This paper cites METRA: Scalable Unsupervised RL with Metric-Aware Abstraction.

Exploration by Running Away from the Past METRA: Scalable Unsupervised RL with Metric-Aware Abstraction

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.901439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 512b8519-aaed-4415-957c-468e426267b8 · outbound

This paper cites Curiosity-driven exploration by self-supervised prediction.

Exploration by Running Away from the Past Curiosity-driven exploration by self-supervised prediction

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.911757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c526c8ad-3378-40e9-b29c-ba8211e66079 · outbound

This paper cites Quality diversity: A new frontier for evolutionary computation.

Exploration by Running Away from the Past Quality diversity: A new frontier for evolutionary computation

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T15:40:23.817369Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation c0969f63-0fcb-4107-9f41-8ab32ad40417 · outbound

This paper cites Markov decision processes: discrete stochastic dynamic programming.

Exploration by Running Away from the Past Markov decision processes: discrete stochastic dynamic programming

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.924720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 05ec055b-250d-4ac9-b6f0-1459c4e9df7f · outbound

This paper cites Proximal Policy Optimization Algorithms.

Exploration by Running Away from the Past Proximal Policy Optimization Algorithms

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.935545Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 27bc0bba-74c6-4ac1-892d-d0d54d2552a5 · outbound

This paper cites Dynamics-Aware Unsupervised Discovery of Skills.

Exploration by Running Away from the Past Dynamics-Aware Unsupervised Discovery of Skills

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.941054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fbb7104e-b710-4690-a7e3-1a50ada25b5b · outbound

This paper cites Loss is its own Reward: Self-Supervision for Reinforcement Learning.

Exploration by Running Away from the Past Loss is its own Reward: Self-Supervision for Reinforcement Learning

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.946923Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a90249a-3c5f-4cbe-875f-f30070f4f9ee · outbound

This paper cites Mujoco: A physics engine for model-based control.

Exploration by Running Away from the Past Mujoco: A physics engine for model-based control

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.953104Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 90937fa2-3ba6-487c-bb54-2064e54cfd0c · outbound

This paper cites Optimal transport: old and new, volume 338.

Exploration by Running Away from the Past Optimal transport: old and new, volume 338

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.959323Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5853646a-b8ee-4150-b821-b535e9233959 · outbound

This paper cites write newline.

Exploration by Running Away from the Past write newline

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.966704Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fc58cd2e-edc9-4505-a366-bb071d2ccd60 · outbound

This paper cites @esa (Ref.

Exploration by Running Away from the Past @esa (Ref

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.974577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ddc433b5-d970-429a-8340-1a47a354753a · outbound

This paper cites an unresolved cited work.

Exploration by Running Away from the Past Unresolved cited work

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.983934Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c83ec66-315c-4467-9424-6b9eadb33835 · outbound

This paper cites an unresolved cited work.

Exploration by Running Away from the Past Unresolved cited work

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-12T15:40:22.993933Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.