Paper Citation Record · LEDGER

Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

As of 22 August 2026, this Paper Citation Record lists 3 of 3 outbound references and 8 inbound Pith citation observations for arXiv:1908.04734.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
1908.04734 v5

Coverage vector

measured 3 of 3 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-14T13:43:30.731503Z

measured 11 of 11 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T10:31:58.520812Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

3 of 3 outbound references displayed

verified exact0
verified fuzzy1
unresolved2
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

2
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 9b147cfd-1eab-490c-b731-1aec4c262895 · outbound

This paper cites an unresolved cited work.

Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-14T13:43:31.019552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 209606be-b88b-4f9c-b976-76c350f25fe2 · outbound

This paper cites an unresolved cited work.

Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-14T13:43:30.884481Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 5ae2c745-9b8d-4c1d-b016-37b0f27321d9 · outbound

This paper cites according to how well the actual states St+1:m optimize the counterfactual reward function.

Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective according to how well the actual states St+1:m optimize the counterfactual reward function

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T13:43:30.762246Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Pith citing papers

Observation 7f8677c2-5b30-41ac-a233-fa9c0bdc1e58 · inbound

RIVAL: Reinforcement Learning with Iterative and Adversarial Optimization for Machine Translation cites this paper.

RIVAL: Reinforcement Learning with Iterative and Adversarial Optimization for Machine Translation Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-07T10:31:58.520812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d85b3b8b-e0fe-4a47-8372-e790844142c7 · inbound

AI Alignment via Incentives and Correction cites this paper.

AI Alignment via Incentives and Correction Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-05-11T17:01:10.371076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation df910814-39e0-40df-9a3c-f5d7c16a6846 · inbound

AI Alignment via Incentives and Correction cites this paper.

AI Alignment via Incentives and Correction Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-05-12T05:51:26.686310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 20557408-85e8-4ef3-bea9-6014f7709f51 · inbound

Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJack cites this paper.

Do Androids Dream of Breaking the Game? Systematically Auditing AI Agent Benchmarks with BenchJack Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 18

Resolution: verified exact; arxiv_id, observed 2026-05-14T20:32:56.877863Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 6450a2a7-a3cb-4be2-9690-80086c5e63eb · inbound

Hide to Guide: Learning via Semantic Masking cites this paper.

Hide to Guide: Learning via Semantic Masking Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 39

Resolution: verified exact; arxiv_id, observed 2026-06-30T12:24:39.987148Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 40b214d8-0f47-4531-811d-777aff5d58fc · inbound

Proxy Reward Internalization and Mechanistic Exploitation: A Learned Precursor to Reward Hacking and Its Generalization cites this paper.

Proxy Reward Internalization and Mechanistic Exploitation: A Learned Precursor to Reward Hacking and Its Generalization Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-07-03T01:37:30.510880Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 7a88bb85-e460-4ef1-b92f-2f796a95c04a · inbound

Reframing AGI Confrontation with Off Earth Autonomy cites this paper.

Reframing AGI Confrontation with Off Earth Autonomy Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 9

Resolution: metadata mismatch; arxiv_id, observed 2026-07-01T08:35:34.306248Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation f1e3aded-70be-4758-abd1-013060a60e25 · inbound

Stop Hand-Holding Your Coding Agent: Engineering the Loops that Replace Step-by-Step Prompting cites this paper.

Stop Hand-Holding Your Coding Agent: Engineering the Loops that Replace Step-by-Step Prompting Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-07-02T20:47:22.264264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.