Pith. sign in

REVIEW 1 cited by

Self-Imitation Learning

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1806.05635 v1 pith:6MZQRKOE submitted 2018-06-14 cs.LG cs.AIstat.ML

Self-Imitation Learning

classification cs.LG cs.AIstat.ML
keywords explorationactor-criticalgorithmgoodimproveslearningpastself-imitation
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

This paper proposes Self-Imitation Learning (SIL), a simple off-policy actor-critic algorithm that learns to reproduce the agent's past good decisions. This algorithm is designed to verify our hypothesis that exploiting past good experiences can indirectly drive deep exploration. Our empirical results show that SIL significantly improves advantage actor-critic (A2C) on several hard exploration Atari games and is competitive to the state-of-the-art count-based exploration methods. We also show that SIL improves proximal policy optimization (PPO) on MuJoCo tasks.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Self-Imitated Diffusion Policy for Efficient and Robust Visual Navigation

    cs.RO 2026-01 conditional novelty 6.0

    SIDP trains a diffusion policy for visual navigation by reward-weighting its own sampled trajectories, improving success rate and cutting inference latency.