Pith. sign in

REVIEW 2 cited by

Advantages and Limitations of using Successor Features for Transfer in Reinforcement Learning

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1708.00102 v1 pith:4INW3W3A submitted 2017-07-31 cs.AI cs.LGstat.ML

classification cs.AIcs.LGstat.ML
keywords featurefeatureslearningrepresentationsuccessoradvantagesapproachlimitations
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

One question central to Reinforcement Learning is how to learn a feature representation that supports algorithm scaling and re-use of learned information from different tasks. Successor Features approach this problem by learning a feature representation that satisfies a temporal constraint. We present an implementation of an approach that decouples the feature representation from the reward function, making it suitable for transferring knowledge between domains. We then assess the advantages and limitations of using Successor Features for transfer.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Adaptive Policy Backbone via Shared Network

    cs.LG 2025-09 conditional novelty 5.0 of 10

    Adapting only linear layers before and after a frozen shared backbone is enough to transfer to out-of-distribution continuous-control tasks, with a theoretical argument and MuJoCo experiments.

  2. Successor Features for Transfer in Alternating Markov Games

    cs.MA 2025-07 reject novelty 5.0 of 10

    A proposed transfer algorithm, GGPI, applies successor features to alternating zero-sum Markov games, but its central theorem is not proven as written.

Pith tools