Paper Citation Record · LEDGER

What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

As of 22 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 33 inbound Pith citation observations for arXiv:2006.05990.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2006.05990 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 33 of 33 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T10:14:54.418091Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

105
pith, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 11bf0bf6-346d-4a68-8682-77a61759fe70 · inbound

What Matters in Learning from Offline Human Demonstrations for Robot Manipulation cites this paper.

What Matters in Learning from Offline Human Demonstrations for Robot Manipulation What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 67

Resolution: verified exact; arxiv_id, observed 2026-05-13T08:51:55.997703Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation edd1cefa-a79c-401e-a686-fd5a82942d12 · inbound

The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models cites this paper.

The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-05-21T07:08:52.801639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 5e7bc265-bb22-4746-9f1c-6b5223fd8b4b · inbound

Mastering Diverse Domains through World Models cites this paper.

Mastering Diverse Domains through World Models What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-05-11T09:08:21.980352Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation edfb77bd-b935-4974-906f-0b7e11c672af · inbound

Multi-Task Reinforcement Learning for Quadrotors cites this paper.

Multi-Task Reinforcement Learning for Quadrotors What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-11T14:08:17.212111Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aba72de6-997b-4df4-a0bc-c14f255886b7 · inbound

Adam on Local Time: Addressing Nonstationarity in RL with Relative Adam Timesteps cites this paper.

Adam on Local Time: Addressing Nonstationarity in RL with Relative Adam Timesteps What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-11T05:51:10.148028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d84dc87-68c2-43ee-b53f-4d0c58b22abf · inbound

Average-Reward Soft Actor-Critic cites this paper.

Average-Reward Soft Actor-Critic What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-10T20:13:57.486495Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c67352e-c4d3-4b5f-b882-fb53c819e4ef · inbound

Simulating Errors in Touchscreen Typing cites this paper.

Simulating Errors in Touchscreen Typing What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-09T04:36:12.619468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 87b35a59-608e-447d-9477-3e97bb1daa7f · inbound

MuJoCo Playground cites this paper.

MuJoCo Playground What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T23:34:10.862569Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a0f3ae6-d2d7-4194-9f6d-698e1499cec5 · inbound

Dynamic Action Interpolation: A Universal Approach for Accelerating Reinforcement Learning with Expert Guidance cites this paper.

Dynamic Action Interpolation: A Universal Approach for Accelerating Reinforcement Learning with Expert Guidance What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-16T10:14:54.418091Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b4b230da-84bc-4768-b4c3-268d49f2c8c0 · inbound

RedRFT: A Light-Weight Benchmark for Reinforcement Fine-Tuning-Based Red Teaming cites this paper.

RedRFT: A Light-Weight Benchmark for Reinforcement Fine-Tuning-Based Red Teaming What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-07T10:55:20.205546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 58df91f7-f6d0-43f2-914c-f803515f43e7 · inbound

Magistral cites this paper.

Magistral What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T04:19:22.151310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9bbad98f-46c2-43b4-bc7a-bd421c171fc0 · inbound

Communicating Smartly in Molecular Communication Environments: Neural Networks in the Internet of Bio-Nano Things cites this paper.

Communicating Smartly in Molecular Communication Environments: Neural Networks in the Internet of Bio-Nano Things What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-06T22:48:46.211558Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 05e8926f-c64c-4013-be31-a7adcfd16cf7 · inbound

On the Effect of Regularization in Policy Mirror Descent cites this paper.

On the Effect of Regularization in Policy Mirror Descent What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T18:18:44.262283Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0922a89a-ec0c-4f0d-984e-0897a8430c28 · inbound

Learning human-to-robot handovers through 3D scene reconstruction cites this paper.

Learning human-to-robot handovers through 3D scene reconstruction What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-06T18:18:26.684738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0bd07b4-47d3-45fb-8dd6-c316ec3a8241 · inbound

Online Training and Pruning of Deep Reinforcement Learning Networks cites this paper.

Online Training and Pruning of Deep Reinforcement Learning Networks What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T17:05:16.167535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d1af3aa-8b4b-4dea-865c-f087b1bfce4d · inbound

Differentiable Weightless Controllers: Learning Logic Circuits for Continuous Control cites this paper.

Differentiable Weightless Controllers: Learning Logic Circuits for Continuous Control What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 2020

Resolution: unresolved; no resolver link, observed 2026-08-03T19:16:26.948543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 16ea3926-2720-442f-ae65-02428ba04317 · inbound

Preventing Learning Stagnation in PPO by Scaling to 1 Million Parallel Environments cites this paper.

Preventing Learning Stagnation in PPO by Scaling to 1 Million Parallel Environments What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-02T18:45:20.216901Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b9348a80-ac48-439d-9a34-652d31809979 · inbound

From $P(y|x)$ to $P(y)$: Investigating Reinforcement Learning in Pre-train Space cites this paper.

From $P(y|x)$ to $P(y)$: Investigating Reinforcement Learning in Pre-train Space What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-05-11T11:41:04.216628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 0897607c-7adc-46df-8bc8-f1172f451575 · inbound

Low-Rank Adaptation for Critic Learning in Off-Policy Reinforcement Learning cites this paper.

Low-Rank Adaptation for Critic Learning in Off-Policy Reinforcement Learning What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 18

Resolution: verified exact; arxiv_id, observed 2026-05-11T12:46:27.889717Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 810aace4-d58a-49c6-85b6-0fb17d21ba16 · inbound

Application of Deep Reinforcement Learning to Event-Triggered Control for Networked Artificial Pancreas Systems cites this paper.

Application of Deep Reinforcement Learning to Event-Triggered Control for Networked Artificial Pancreas Systems What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 45

Resolution: verified exact; arxiv_id, observed 2026-05-12T00:41:16.498617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation ec7d7e36-c90a-4688-b726-47c03e42b11c · inbound

Application of Deep Reinforcement Learning to Event-Triggered Control for Networked Artificial Pancreas Systems cites this paper.

Application of Deep Reinforcement Learning to Event-Triggered Control for Networked Artificial Pancreas Systems What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 45

Resolution: verified exact; arxiv_id, observed 2026-05-19T17:47:41.630296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e5544742-6a92-4df8-8429-0affd16ea488 · inbound

Hint Tuning: Less Data Makes Better Reasoners cites this paper.

Hint Tuning: Less Data Makes Better Reasoners What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 38

Resolution: verified exact; arxiv_id, observed 2026-05-12T08:36:26.341552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 2306338e-254c-4b5e-a92e-c19e3e962391 · inbound

Hint Tuning: Less Data Makes Better Reasoners cites this paper.

Hint Tuning: Less Data Makes Better Reasoners What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 38

Resolution: verified exact; arxiv_id, observed 2026-06-30T23:35:07.063312Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation fd05a4da-3bbf-4276-a8e5-fcb36ddeedbf · inbound

TuniQ: Autotuning Compilation Passes for Quantum Workloads at Scale for Effectiveness and Efficiency cites this paper.

TuniQ: Autotuning Compilation Passes for Quantum Workloads at Scale for Effectiveness and Efficiency What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-05-13T02:52:08.830825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation ed702539-4593-4c4c-9d30-38c779010c53 · inbound

TOPPO: Rethinking PPO for Multi-Task Reinforcement Learning with Critic Balancing cites this paper.

TOPPO: Rethinking PPO for Multi-Task Reinforcement Learning with Critic Balancing What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 1

Resolution: metadata mismatch; arxiv_id, observed 2026-05-13T01:52:05.744552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e8ccc653-d395-4959-978f-9d755b9a10bb · inbound

Randomized Advantage Transformation (RAT): Computing Natural Policy Gradients via Direct Backpropagation cites this paper.

Randomized Advantage Transformation (RAT): Computing Natural Policy Gradients via Direct Backpropagation What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 98

Resolution: metadata mismatch; arxiv_id, observed 2026-05-20T12:48:17.499793Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 4a2c263d-a5cb-48b1-aca4-b3c0ef4abb7b · inbound

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks? cites this paper.

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks? What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-06-28T23:42:49.605925Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 4249dc2e-3a72-431a-b874-9af188867e0a · inbound

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks? cites this paper.

When are LLMs Sufficient Policy Optimizers for Sequential RL Tasks? What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-06-29T05:43:07.739085Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation ea047044-d8ca-484c-88d2-a6d70d7ccaf6 · inbound

PowerOPD: Stabilizing On-Policy Distillation with Bounded Power Transformation cites this paper.

PowerOPD: Stabilizing On-Policy Distillation with Bounded Power Transformation What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 38

Resolution: metadata mismatch; arxiv_id, observed 2026-07-03T17:48:46.310519Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 69add4d6-dddd-4560-a164-723cc1443895 · inbound

Learning to Trigger: Reinforcement Learning at the Large Hadron Collider cites this paper.

Learning to Trigger: Reinforcement Learning at the Large Hadron Collider What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-07-04T10:39:45.862272Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation ae2dde90-abce-4a0e-ae84-b3abf3babac2 · inbound

Learning to Trigger: Reinforcement Learning at the Large Hadron Collider cites this paper.

Learning to Trigger: Reinforcement Learning at the Large Hadron Collider What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-06-30T11:54:39.123007Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation c078e5ea-f243-46fc-a542-efdd9bed50b0 · inbound

The Importance of Encoder Choice:A Tabular-Image Study cites this paper.

The Importance of Encoder Choice:A Tabular-Image Study What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 168

Resolution: verified exact; local_arxiv, observed 2026-07-10T19:07:34.906671Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation cc5631e0-0328-4c37-8697-398b072ed5b0 · inbound

V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control cites this paper.

V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Study

Reference 74

Resolution: unresolved; no resolver link, observed 2026-08-12T00:48:44.428924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.