Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-09T20:58:30.177720Z
Paper Citation Record · LEDGER
As of 15 August 2026, this Paper Citation Record lists 51 of 51 outbound references and 3 inbound Pith citation observations for arXiv:2501.19254.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-09T20:58:30.177720Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-05-20T22:34:05.838427Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-05-20T22:34:09.275036Z
51 of 51 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 36993655-962a-4d50-9df2-2f42138b16d9 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set write newline
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ca0f78ec-4fd1-4ba3-829f-25503527166e · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 0cf194cd-20f1-4293-8500-e43a9462d597 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set First-order methods in optimization
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 21f23488-367d-429e-9ee2-49433e08f2d6 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set A Markovian decision process
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 74714a0b-bcff-446d-b52c-f2664339746b · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Adaptive Algorithms and Stochastic Approximations
Reference 5
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 22e9fad4-e53d-4e1d-b15b-d1738b0bf16d · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Stochastic approximation: a dynamical systems viewpoint
Reference 6
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation be507291-899f-4fe1-b39d-81fa98b0a64e · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set The ODE method for asymptotic statistics in stochastic approximation and reinforcement learning
Reference 7
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation f523b574-2638-46fe-823f-fb200063030b · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set D., and Wang, Z
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 8e655a9c-0dd4-4419-8e84-2830d3ec41d4 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set S., and Santos, P
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation e4df219c-019c-4c79-a391-498b63dda8e8 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Zhao, L
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation b3f740b2-af26-4a5d-95e9-fae02cfed326 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set T., Shakkottai, S., and Shanmugam, K
Reference 11
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 94dade05-3c28-47fe-912b-ebcba9b1d1dd · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set T., Maguluri, S
Reference 12
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 147eeda4-a667-4d21-b5d8-2e685798b24b · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set P., and Maguluri, S
Reference 13
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation e3597ec1-2087-432a-ba1d-6caf3d63e160 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set T., and Zubeldia, M
Reference 14
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 097a0c5c-d6c2-496a-b271-0a673294059e · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation e49b25aa-5768-4420-8d29-fe28c3fa3505 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Learning rates for Q-learning
Reference 16
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 50e030d0-6e9a-437f-999a-63e28936ddd0 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set A theoretical analysis of deep Q-Learning
Reference 17
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 30024e98-be1f-4070-b1a6-65b4403d43f6 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Thoppe, G
Reference 18
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation cf449a89-630a-4e74-89f9-e759d6ed5071 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Boundedness of iterates in Q-learning
Reference 19
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation ab2de571-7c9a-41f0-8742-7e7a1f2c8191 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Donghwan, L
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 2abc488c-6815-4fd9-acd7-2fc770dcfc56 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Convergence of stochastic iterative dynamic programming algorithms
Reference 21
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation af605be1-789c-4f4c-bcb7-40ab2e86f5a4 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Exponential hardness of reinforcement learning with linear function approximation
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation ac00abf5-f772-4bcd-bbd4-8dacaeef6af5 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 23
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 6af5b5c5-1147-434d-96e9-48c17f3b1a0d · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 61401d30-56de-455b-8acb-013d1d23378c · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Yin, G
Reference 25
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 86a32984-15b8-4566-b662-518aa055615a · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and He, N
Reference 26
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 735f8e06-d9d0-4a82-b6ca-5b5f14708115 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Is Q-learning minimax optimal? a tight sample complexity analysis
Reference 27
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 586ba490-444e-4b60-9e33-2ac17e9460ac · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 3d0236e0-685c-43c6-80c3-a0d3a2f45425 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 29
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 91d28fff-0ec5-4729-87ef-b5883f8c0ce9 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set The ODE method for stochastic approximation and reinforcement learning with markovian noise
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation d353bbdf-7db6-42d9-8054-da0396cfdaec · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Tsitsiklis, J
Reference 31
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 25d3d80d-462a-4c8b-bf90-2d5b3f0ff733 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set S., Meyn, S
Reference 32
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 2abb70ce-03c6-4999-ae83-c49b3790b1c1 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set The projected bellman equation in reinforcement learning
Reference 33
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 93ecb8cc-cd3f-466f-ba2b-79f345a76951 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set A., Veness, J., Bellemare, M
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3135a3b8-9ff9-43c0-881c-a461fe61bd84 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Gharesifard, B
Reference 35
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 10df2676-522a-4a07-a883-b352416d928a · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Almost sure convergence rates and concentration of stochastic approximation and reinforcement learning with markovian noise
Reference 36
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 91a537ef-454f-41f3-957b-7f6f17892b11 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 48b790ea-a766-46f5-a630-5c0803fe35b9 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation b7f7c519-4037-4712-91a1-5ea044dc45e4 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set The asymptotic convergence-rate of Q-learning
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation a44c37db-d70e-4e71-8cc1-574dd8c7b253 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation db4ebd1a-0cb3-4be6-9bd7-ae655731f9a9 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation f2c0bf0b-ba49-463e-b799-fb40a67a6088 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Unresolved cited work
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 25726b4e-0b1b-4379-8dab-857216be19cd · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set A finite-time analysis of two time-scale actor-critic methods
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 97c06f47-f27e-4604-af1e-454b8882815f · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Gu, Q
Reference 44
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation a6697c8a-c688-44d6-86b2-06108e35c5ec · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Provably convergent two-timescale off-policy actor-critic with function approximation
Reference 45
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation a3138edf-0121-4d6d-b436-10662e8720bf · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Breaking the deadly triad with a target network
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation c163ce65-0e5d-47f4-8744-bba20c400e72 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Global optimality and finite sample analysis of softmax off-policy actor critic under state distribution mismatch
Reference 47
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation ebf40e84-ab56-4b01-9aad-90382fe31612 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set T., and Laroche, R
Reference 48
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 843744d8-6dd9-4332-8b3d-d730a85110ab · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set On the convergence and sample complexity analysis of deep q-networks with -greedy exploration
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 5cd36632-0109-4d69-a2ed-d0fda9ef87fe · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set and Xie, Q
Reference 50
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 44efca40-5a04-470f-8d0e-0b08cb185131 · outbound
Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set Finite-sample analysis for SARSA with linear function approximation
Reference 51
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation b42121ae-070b-4859-85e6-37be898e1cdc · inbound
A Minimal-Assumption Analysis of Q-Learning with Time-Varying Policies Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set
Reference 25
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 94bc028b-1789-43f7-b855-2690b0f69a4c · inbound
A Switching System Theory of Q-Learning with Linear Function Approximation Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.
Observation 827a4c9f-7183-4d24-a336-a71cb2bad00d · inbound
A Switching System Theory of Q-Learning with Linear Function Approximation Linear $Q$-Learning Does Not Diverge in $L^2$: Convergence Rates to a Bounded Set
Reference 24
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.