Pith. sign in

Paper Citation Record · LEDGER

Reusability and Transferability of Macro Actions for Reinforcement Learning

As of 18 August 2026, this Paper Citation Record lists 26 of 26 outbound references and 1 inbound Pith citation observation for arXiv:1908.01478.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
1908.01478 v3

Coverage vector

measured 26 of 26 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-14T15:17:04.980873Z

measured 27 of 27 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T00:33:24.897577Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-07T00:33:25.223550Z

Reference resolution

26 of 26 outbound references displayed

  • verified exact1
  • verified fuzzy6
  • unresolved18
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e2f4f629-6eea-4476-8a7c-332e3a7c39bd · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.425670Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.869851Z digest=sha256:1d277e481ee1078eeae341096c20f3cde04105301cc50b3ff4caa4e801f3db14

Observation ffe4a0fb-2c4b-44a3-bec8-616d0dbbe55e · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.411290Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.875194Z digest=sha256:e777485234828bac47deef560e35acb10a67e19283970c4ac0dc41d70287cb65

Observation fceac9f7-b01d-4437-b88e-b5108e24b792 · outbound

This paper cites Playing Atari with Deep Reinforcement Learning.

Reusability and Transferability of Macro Actions for Reinforcement Learning Playing Atari with Deep Reinforcement Learning

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-14T15:17:04.879956Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:17:04.879956Z digest=sha256:8f5293eacdaa84396cea0c47f4bfe716512a312f05af5d7cfeffccdd13ac85b0

Observation 808767ba-b626-48a1-a378-5ca0e667e892 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.396271Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.884901Z digest=sha256:212cbe7279d8f6382fba3435931fd7542b27dfca5234815ccc7215313b64b65e

Observation 334a42c1-c2ba-4a4b-a6f4-a857009fef5d · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.381690Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.889945Z digest=sha256:0df329b35de187d297973fbd8fccb082530181c5de34a433261e33afec8b55f6

Observation d4bf109b-8995-4b78-983c-40525f52b30d · outbound

This paper cites Evolution Strategies as a Scalable Alternative to Reinforcement Learning.

Reusability and Transferability of Macro Actions for Reinforcement Learning Evolution Strategies as a Scalable Alternative to Reinforcement Learning

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-14T15:17:04.894486Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:17:04.894486Z digest=sha256:4064e5b12af36834db857c462290ac32de30346bb3624c6000b50b3377be180d

Observation 59a4a3e1-2036-4b6f-a479-2c1fef4abf89 · outbound

This paper cites Proximal Policy Optimization Algorithms.

Reusability and Transferability of Macro Actions for Reinforcement Learning Proximal Policy Optimization Algorithms

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-14T15:17:04.898997Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:17:04.898997Z digest=sha256:63e98e4340f13262809d8d3dde932cae630f4bf41a08f56dd9cd40a30af6f09d

Observation 41e02989-67a8-4057-a812-b5d1f1917482 · outbound

This paper cites Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning.

Reusability and Transferability of Macro Actions for Reinforcement Learning Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-14T15:17:04.903185Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:17:04.903185Z digest=sha256:a90fa387af35cfe03f7bb2a91d77719ac26030579b742087f36e0396cfa42552

Observation 42cd8f92-5e30-43e1-8603-d09c74ef940b · outbound

This paper cites Deep Reinforcement Learning With Macro-Actions.

Reusability and Transferability of Macro Actions for Reinforcement Learning Deep Reinforcement Learning With Macro-Actions

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-14T15:17:04.907470Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-14T15:17:04.907470Z digest=sha256:17575b4a2f45ab0eb14e54f516fbf893936f2b6db269db9e0b1d2fa61412e431

Observation f5db4e60-8324-4881-97b5-375d0560ea43 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.366475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.912093Z digest=sha256:e4c631f9f08a5b443246ab5f7d31c7292e5cb4f4d481dd4af3ba076f050254bb

Observation 190b9a9e-62a7-4da5-8083-321513d9fd9b · outbound

This paper cites Macro Action Reinforcement Learning with Sequence Disentanglement using Variational Autoencoder.

Reusability and Transferability of Macro Actions for Reinforcement Learning Macro Action Reinforcement Learning with Sequence Disentanglement using Variational Autoencoder

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-08-14T15:17:05.029826Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.916233Z digest=sha256:485565361eb947afc119a7b95889d759081e824a9d9cdc53ab53e939c6b66ad0

Observation df2b35cf-a844-4204-83c9-a47b661c74b3 · outbound

This paper cites Feedback and control systems.

Reusability and Transferability of Macro Actions for Reinforcement Learning Feedback and control systems

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:17:05.351853Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.920885Z digest=sha256:fd81d4aaa26523ae1f7b07b35d856b83d1e53be74f8c49eac22d7b1c3c4c60f1

Observation 570749b0-2f0c-4a69-9977-51eecdb19d97 · outbound

This paper cites Botea, M.

Reusability and Transferability of Macro Actions for Reinforcement Learning Botea, M

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:17:05.337825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.925749Z digest=sha256:4b0574a7fc0f9197335c91e3eeb7481a5a9799bc4a2e59cdc94d401f98130d9a

Observation 0012f4bd-62b4-4cd7-bcda-42ecb718cf66 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.324236Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.929832Z digest=sha256:025de0f217af0277f6469344890370845a2713944518427351ebb98c0a7ad2d7

Observation 63bd672b-1973-4986-8d21-a5f0411ab638 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.309680Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.933974Z digest=sha256:b24c7f090d8c5b388223ccd32e499ef946f13d77a2547151ee8c0b68ca280772

Observation c0d18a4b-d7db-4bf5-909d-71672fc16acc · outbound

This paper cites DeJong and R.

Reusability and Transferability of Macro Actions for Reinforcement Learning DeJong and R

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:17:05.295421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.937614Z digest=sha256:e5ff1ce26c0ba23783977374567230deec7949f5a8e2598ad5f320907f729807

Observation f0fbd5ab-25bd-41a3-bd5a-4cfdd5408dd8 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.278563Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.941612Z digest=sha256:e5b74489c97a1cdb312c0ca0afc85099b3e51d0935188b7076191d6b3b196081

Observation b2e1b9d4-f8cf-494a-8865-4743ff9eb7e7 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.264987Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.945505Z digest=sha256:5b8919672cd9ed0346b0ff60ab7f992e52c1a1e71e9524b4404c99a6074c4315

Observation a69c104d-1468-40f6-8733-22f9d29eaa45 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.250162Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.950229Z digest=sha256:16794bff3fed7ece57c044eb9651461d08d4c5d2e3d5516b8bf532a666e0960b

Observation 6305cfb5-bdaf-465e-b8bb-05d932373597 · outbound

This paper cites Asai and A.

Reusability and Transferability of Macro Actions for Reinforcement Learning Asai and A

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:17:05.232093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.954312Z digest=sha256:96cd0c9db4de2c5eb1f6b3c4bacae2c0d6ee9b7e0c7d5a094376c93ba0259594

Observation 2781ff0c-9a6c-489c-8425-00aaa6b8c660 · outbound

This paper cites Chrpa and M.

Reusability and Transferability of Macro Actions for Reinforcement Learning Chrpa and M

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:17:05.209942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.958824Z digest=sha256:b58bde776b688bdad15c1a0720725e0abb3432fd1a84109927852098d31be215

Observation a765ab8c-472c-4ef4-bede-4358db377613 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.192969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.963681Z digest=sha256:d851452a3caac5d5be6599345dee38b22068906890ddbdac3d83c424a5143cce

Observation a40d3eaa-a1ad-4573-9a6e-ff5bda793556 · outbound

This paper cites An introduction to genetic algorithms.

Reusability and Transferability of Macro Actions for Reinforcement Learning An introduction to genetic algorithms

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-14T15:17:05.176824Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.968173Z digest=sha256:3722bdb679e23622cd29b27f98d9ace3ae94ad4c17d3917f622a777da64e7d5f

Observation e665ad4f-ffe9-4680-b90d-84c8977016f6 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.158590Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.972271Z digest=sha256:11d7ee2e6983228a752500b2abe42eb22ba20c523f252cf94dfe239ab909c95e

Observation e6521692-1a08-43e4-bad2-b8c799f36c06 · outbound

This paper cites an unresolved cited work.

Reusability and Transferability of Macro Actions for Reinforcement Learning Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-14T15:17:05.138139Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.976608Z digest=sha256:1fcdbbc6b5b9c8df24e2a810d238aab1ec15fd40e9e425e6b2a5a5fe44411e54

Observation d7e04c24-912e-4fe5-a00c-c6124ab62388 · outbound

This paper cites last 100 episode rewards.

Reusability and Transferability of Macro Actions for Reinforcement Learning last 100 episode rewards

Reference 26

Resolution
malformed identifier
raw_fallback, observed 2026-08-14T15:17:05.122943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-14T15:17:04.980873Z digest=sha256:8996b2c8389cf3a9c9c36be78033098ad4d50f2353cd3fe915153a11810b42af

Pith citing papers

Observation 08dc6753-272d-4a80-9ee9-df5b85750ee3 · inbound

Meta-learning how to Share Credit among Macro-Actions cites this paper.

Meta-learning how to Share Credit among Macro-Actions Reusability and Transferability of Macro Actions for Reinforcement Learning

Reference 19

Resolution
metadata mismatch
local_arxiv, observed 2026-08-07T00:33:25.228396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T00:33:24.897577Z digest=sha256:b8e76be1a72004c6cf1dd3921c2389c2a4b53d5431842ba86a5c0c5097e979d6