Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-06T18:01:47.191696Z
Paper Citation Record · LEDGER
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values
As of 7 August 2026, this Paper Citation Record lists 27 of 27 outbound references and 0 inbound Pith citation observations for arXiv:2507.09523.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-06T06:34:29.942622+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
27 of 27 outbound references displayed
- verified exact1
- verified fuzzy17
- unresolved9
- parse uncertain0
- malformed identifier0
- metadata mismatch0
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation 82aaab77-0338-46e0-bb06-92e787f30d06 · outbound
This paper cites write newline.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values write newline
Reference 1
- Resolution
- unresolved
- no resolver link, observed 2026-08-06T18:01:44.735602Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a2eb5b45-b5dc-4f01-b32a-fa21b259404f · outbound
This paper cites an unresolved cited work.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Unresolved cited work
Reference 2
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T18:01:51.426569Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 49aac7d9-f0e4-4fd7-be52-3ff2dcc6abd5 · outbound
This paper cites Sur les op \'e rations dans les ensembles abstraits et leur application aux \'e quations int \'e grales.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Sur les op \'e rations dans les ensembles abstraits et leur application aux \'e quations int \'e grales
Reference 3
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:51.113175Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 88c31345-0586-4a52-b1f5-a7038a19a76d · outbound
This paper cites Dynamic Programming.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Dynamic Programming
Reference 4
- Resolution
- unresolved
- no resolver link, observed 2026-08-06T18:01:45.055174Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7450fe15-d8bf-428c-9bda-665639b9468a · outbound
This paper cites Bertsekas and John N.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Bertsekas and John N
Reference 5
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:50.904931Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation fbe8b06b-4a0d-4413-a3e5-73037c103b4f · outbound
This paper cites Multistep Credit Assignment in Deep Reinforcement Learning.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Multistep Credit Assignment in Deep Reinforcement Learning
Reference 6
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:50.775974Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 49119f6f-aff3-4fbb-8560-2f69162cbcff · outbound
This paper cites ChainerRL : A deep reinforcement learning library.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values ChainerRL : A deep reinforcement learning library
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:50.632827Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 7dfa3418-b4fe-4d31-83b9-87ac0e446569 · outbound
This paper cites an unresolved cited work.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Unresolved cited work
Reference 8
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T18:01:50.491388Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation d742ebfd-07fc-4337-90c9-25fd85e9f059 · outbound
This paper cites Kingma and Jimmy Ba.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Kingma and Jimmy Ba
Reference 9
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:50.360877Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 58a7a71b-afa8-4ac7-82b8-9c0fbb5dfb7a · outbound
This paper cites Orr, and Klaus-Robert M \"u ller.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Orr, and Klaus-Robert M \"u ller
Reference 10
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:50.213833Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 9a3e49df-698b-4a37-8b30-74688ca8b8b5 · outbound
This paper cites Rusu, Joel Veness, Marc G.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Rusu, Joel Veness, Marc G
Reference 11
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:50.064504Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation c9259be3-76b0-4b10-a6a0-c393a0c51e4d · outbound
This paper cites Towards model-free RL algorithms that scale well with unstructured data.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Towards model-free RL algorithms that scale well with unstructured data
Reference 12
- Resolution
- verified exact
- local_arxiv, observed 2026-08-06T18:01:47.519541Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 03ae75ac-1be6-466a-bae3-d767da002530 · outbound
This paper cites Revisiting Rainbow : Promoting more insightful and inclusive deep reinforcement learning research.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Revisiting Rainbow : Promoting more insightful and inclusive deep reinforcement learning research
Reference 13
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:49.937782Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation b6d1f872-1467-4ef7-83ea-07d58b4a3290 · outbound
This paper cites Rummery and Mahesan Niranjan.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Rummery and Mahesan Niranjan
Reference 14
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:49.834689Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 49ad9446-5ee9-4e3d-b989-db0a0616c173 · outbound
This paper cites an unresolved cited work.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Unresolved cited work
Reference 15
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T18:01:49.703269Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 8cff4409-b4e7-4c88-bd2e-fb44c043a8b3 · outbound
This paper cites Littman, and Csaba Szepesv \'a ri.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Littman, and Csaba Szepesv \'a ri
Reference 16
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:49.575152Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 58931b2f-9137-4d8e-a2c7-a1c07d8fb3ce · outbound
This paper cites an unresolved cited work.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Unresolved cited work
Reference 17
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T18:01:49.427621Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 90ab8c3d-19a9-4e2f-8f9d-8f470a925902 · outbound
This paper cites Sutton and Andrew G.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Sutton and Andrew G
Reference 18
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:49.289687Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 380e6ba9-f74a-4281-accb-a82f3045e7c2 · outbound
This paper cites VA-learning as a more efficient alternative to Q-learning.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values VA-learning as a more efficient alternative to Q-learning
Reference 19
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:49.135279Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 41bad30e-a29f-44fd-993e-b5942ea11e2f · outbound
This paper cites Double Q-learning.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Double Q-learning
Reference 20
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:48.994867Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 2413f22d-5b75-47ec-b6f8-1940c20fd601 · outbound
This paper cites Insights in Reinforcement Learning.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Insights in Reinforcement Learning
Reference 21
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:48.840394Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 344721d1-d006-4cd5-be36-51e75d1f6521 · outbound
This paper cites Dueling network architectures for deep reinforcement learning.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Dueling network architectures for deep reinforcement learning
Reference 22
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:48.710073Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 3bc160fe-f2bf-477d-8e61-9713e3fe5b9d · outbound
This paper cites an unresolved cited work.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Unresolved cited work
Reference 23
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T18:01:48.572660Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 15cdb5f2-f4e9-43b5-91fa-fc55735cdd2f · outbound
This paper cites an unresolved cited work.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Unresolved cited work
Reference 24
- Resolution
- unresolved
- raw_fallback, observed 2026-08-06T18:01:48.406295Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation a390f672-f32c-42d0-aa0d-86a298d88ebc · outbound
This paper cites Wiering and Hado van Hasselt.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Wiering and Hado van Hasselt
Reference 25
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:48.101275Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation d490c7c4-2992-4a36-8d87-4706443e9f22 · outbound
This paper cites Wiering and Hado van Hasselt.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values Wiering and Hado van Hasselt
Reference 26
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-06T18:01:47.826751Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation 85b62dba-ea0f-4746-a7cd-3f2f496889b6 · outbound
This paper cites MinAtar: An Atari-Inspired Testbed for Thorough and Reproducible Reinforcement Learning Experiments.
An Analysis of Action-Value Temporal-Difference Methods That Learn State Values MinAtar: An Atari-Inspired Testbed for Thorough and Reproducible Reinforcement Learning Experiments
Reference 27
- Resolution
- unresolved
- no resolver link, observed 2026-08-06T18:01:47.191696Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Pith citing papers
No inbound Pith citation observations are available.