Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-02T05:44:33.680003Z
Paper Citation Record · LEDGER
As of 7 August 2026, this Paper Citation Record lists 56 of 56 outbound references and 0 inbound Pith citation observations for arXiv:2607.13274.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-02T05:44:33.680003Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-06T06:34:29.942622+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
56 of 56 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 76181836-1d2f-4406-9fe1-d9a89c40dbb7 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Mastering the game of Go without human knowledge.Nature, 550:354–359, 2017
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 59852375-7144-44d1-940a-20658f9d4847 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Unresolved cited work
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e89e5b8a-40e7-454e-8148-cf1139b16432 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Wurman, Samuel Barrett, Kenta Kawamoto, James MacGlashan, Kaushik Sub- ramanian, Thomas J
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b4607d67-9f1c-405d-9864-2c677e2bb66a · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Magnetic control of tokamak plasmas through deep reinforcement learning.Nature, 602:414–419, 2022
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a1b5f11a-da62-4b10-b9cc-8799fa724a69 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Dense reinforcement learning for safety validation of autonomous vehicles.Nature, pages 620–627, 2023
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bd4bbc9d-398a-4ac5-9dea-54f8ae4f78b0 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners A survey of reinforcement learning for software engineering, 2025
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation be714932-901a-4db4-9703-3cd568a0519d · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Rainbow: Combining im- provements in deep reinforcement learning
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b4303a44-34aa-4d46-9466-6608155991e0 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Noisy networks for exploration
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a944e7ce-44de-48dd-8e4d-677ab55be01b · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners A distributional perspective on rein- forcement learning
Reference 9
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 22a7e2b2-29e6-4412-81de-81d1231e7b29 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Prioritized Experience Replay
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6b2a0f1c-0755-4013-b223-82f82ac2067a · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners The arcade learning environment: An evaluation platform for general agents.Journal of artificial intelligence research, 47:253–279, 2013
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fc7f2cef-3918-4a40-8a1c-d78b0d02dca5 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Revisiting rainbow: Promoting more insightful and inclusive deep reinforcement learning research
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8c522549-04fd-4eef-a2b6-25f6d23fa443 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Soft actor-critic: Off- policy maximum entropy deep reinforcement learning with a stochastic actor
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3622c9b4-b431-4b34-b57d-4232e433564d · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Mujoco: A physics engine for model-based control
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cb76570f-75c5-4c89-a37f-a6884f7e255b · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners DeepMind Control Suite
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2d45eb03-2ba0-431c-8b8b-2cbc5e397cea · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Maximum a posteriori policy optimisation
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 48312fc9-f76d-4fdd-bcf4-8928084190ba · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Greedy actor-critic: A new conditional cross-entropy method for policy im- provement
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2a8c6eac-f866-4e6a-b9bd-1ec76db9abd2 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Offline reinforcement learn- ing with tsallis regularization.Transactions on Machine Learning Research, 2024
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 381f5ffd-61bc-44c1-87d7-054c39b80524 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Trust region policy optimization
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 67699977-a8ed-4fc4-8b97-8c5271e0a354 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Proximal Policy Optimization Algorithms
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fa2c6676-148b-487a-9451-0cb1bfcf320b · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Lillicrap, Jonathan J
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation df7e68d9-646a-47fb-839f-9fbe7ba5a81f · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Al-Sakkari, Ahmed Ragab, Mohamed Ali, Hanane Dagdougui, and Daria C
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.
Observation f64d9506-0b65-41d6-b332-2b56207d0c84 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Williams
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b752b392-1d7b-4d64-96c2-a63a5491fb2a · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Rupam Mahmood, and Martha White
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 58c5a498-9f74-4ba4-bb0b-37901f2ac260 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Mirror descent and nonlinear projected subgradient methods for convex optimization.Operations Research Letters, 31(3):167–175, 2003
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8d621a94-4a8a-452b-9391-e1ab9efdc825 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Investigating the utility of mirror descent in off-policy actor-critic
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 04eecc7d-6ba6-4fde-ab13-d21ffb221b69 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Leverage the average: an analysis of regularization in rl
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 67ac4cf5-be0f-41ff-afe9-1634ad231491 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Mirror descent policy optimization
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1e891a81-6264-431b-bb8d-46f584c05af3 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Machado, Pablo Samuel Castro, and Nicolas Le Roux
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6c47e1de-26fa-4673-b753-b9c88acda69e · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Approximately optimal approximate reinforcement learn- ing
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 17bad94f-2570-41c3-838c-93adbc75832e · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Revisiting mixture policies in entropy-regularized actor-critic
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 85a58543-8e10-4b50-9dc5-6e709fc0af7f · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Improving stochastic policy gradi- ents in continuous control with deep reinforcement learning using the beta distribution
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0b2f2a20-a5d4-4ea3-9e12-233a9e2a24ad · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Student-t policy in reinforcement learning to acquire global optimum of robot control.Applied Intelligence, 49(12):4335–4347, 2019
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cd677f8a-2668-4017-b1d8-b920c087939f · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners q-exponential policy optimization
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dd697e9d-b983-4464-8662-6d3bab226f82 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Policy Representation via Diffusion Probability Model for Reinforcement Learning
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 131fc597-58d5-4fb6-a993-89847e6b741a · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Learning a Diffusion Model Policy from Rewards via Q-Score Matching
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ebf78c45-fe66-4109-8457-dbd017bb2122 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Diffusion-based reinforcement learning via q-weighted variational policy opti- mization.Advances in Neural Information Processing Systems, 37:53945–53968, 2024
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 73ccc44a-1e9e-4a18-bb03-ac97bfc23d00 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Addressing function approximation error in actor-critic methods
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7117d35f-2783-43b5-9836-874abf3dd5ca · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Sampling from energy- based policies using diffusion.Reinforcement Learning Journal, 6:2291–2307, 2025
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 36910a57-7546-4778-8251-6b6599474f86 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners The primacy bias in deep reinforcement learning
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f7108f00-a3e7-4df8-bfb1-436926ae75dd · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Addressing the plasticity- stability dilemma in reinforcement learning.arXiv preprint arXiv:2512.01034, 2025
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 842181b4-1d58-46be-9e82-a2bf4e6ed9a1 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Sample-efficient reinforcement learning by breaking the replay ratio barrier
Reference 42
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 41ce20f4-2251-4e64-8f52-c79e484116cb · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Mad-td: Model-augmented data stabilizes high update ratio rl
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 818b023d-dd62-452f-98d8-fb451027ef8b · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Stochastic approximation with two time scales.Systems & Control Letters, 29(5):291–294, 1997
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 391ac6bd-0c48-4198-b938-9b9795d6df0e · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Actor-critic algorithms.Advances in neural information processing systems, 12, 1999
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 71942004-296b-4e93-b1df-62a99b4bff43 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Sutton, Mohammad Ghavamzadeh, and Mark Lee
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fe2f7147-e909-46e6-9b9a-7582c394ff28 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Likelihood ratio gradient estimation for stochastic systems.Communications of the ACM, 33(10):75–84, 1990
Reference 47
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f0394865-a082-433e-8b6f-e4fe874cabba · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Auto-Encoding Variational Bayes
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b96b1259-a825-477f-8179-6e7d8912837f · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Categorical Reparameterization with Gumbel-Softmax
Reference 49
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f7eea0fb-51a1-4c6b-b58b-f27c934d7922 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Variance reduction properties of the reparameterization trick
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 45bf848a-18c9-400a-8924-47603f8b1aa6 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Pipps: Flexible model-based policy search robust to the curse of chaos
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0329d157-f071-4f2d-9fc5-0fdf011a2e18 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Pid controllers: theory, design, and tuning.The international society of measurement and control, 1995
Reference 52
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9a40193e-c5ad-48bd-8820-0d92e43bef11 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Fat-to-thin policy optimization: Offline rl with sparse policies
Reference 53
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c3b3a3fa-98cb-47df-98ab-0bc9931f7baa · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Unresolved cited work
Reference 54
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8bb9d238-ec1c-4719-8711-5b07d498252d · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Unresolved cited work
Reference 55
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 35dea39d-dfa5-42d1-b459-eb75807c0839 · outbound
Deconstructing Actor-Critic: A Large-scale Empirical Study of Design Components for Practitioners Unresolved cited work
Reference 56
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
No inbound Pith citation observations are available.