Pith. sign in

REVIEW 4 cited by

Execute Order 66: Targeted Data Poisoning for Reinforcement Learning

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2201.00762 v2 pith:B6N75HTU submitted 2022-01-03 cs.LG cs.AIcs.CR

Harrison Foley , Liam Fowl , Tom Goldstein , Gavin Taylor This is my paper · ORCID
classification cs.LGcs.AIcs.CR
keywords learningreinforcementpoisoningcontroldatapolicytargetedaccomplish
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Data poisoning for reinforcement learning has historically focused on general performance degradation, and targeted attacks have been successful via perturbations that involve control of the victim's policy and rewards. We introduce an insidious poisoning attack for reinforcement learning which causes agent misbehavior only at specific target states - all while minimally modifying a small fraction of training observations without assuming any control over policy or reward. We accomplish this by adapting a recent technique, gradient alignment, to reinforcement learning. We test our method and demonstrate success in two Atari games of varying difficulty.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Provably Efficient Action-Manipulation Attack Against Continuous Reinforcement Learning

    cs.LG 2024-11 reject novelty 7.0 of 10

    LCBT is a trajectory-only tree-search attack that claims to steer continuous-action RL agents to target policies with sublinear attack cost, but the proof of the claim has a serious importance-sampling flaw.

  2. Beyond Training-time Poisoning: Component-level and Post-training Backdoors in Deep Reinforcement Learning

    cs.LG 2025-07 conditional novelty 6.0 of 10

    Backdoors in deep RL agents can be planted by compromising a training component or by editing pretrained weights with no training data, matching training-time attack success on six Atari games.

  3. Online Poisoning Attack Against Reinforcement Learning under Black-box Environments

    cs.LG 2024-12 conditional novelty 6.0 of 10

    An online attacker knowing only which states are reachable can poison rewards and transitions to make a Q-learning agent follow a target policy in a maze.

  4. Trading Devil RL: Backdoor attack via Stock market, Bayesian Optimization and Reinforcement Learning

    cs.LG 2024-12 reject novelty 2.0 of 10

    A data-poisoning backdoor attack on audio transformers is claimed with 100 percent success on TIMIT, but the paper provides no reproducible derivation or evaluation.

Pith tools