Pith. sign in

REVIEW 1 cited by

A General Family of Robust Stochastic Operators for Reinforcement Learning

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1805.08122 v2 pith:KN63SWW6 submitted 2018-05-21 stat.ML cs.LG

classification stat.MLcs.LG
keywords operatorsfamilylearningreinforcementresultsrobustactionalleviating
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We consider a new family of operators for reinforcement learning with the goal of alleviating the negative effects and becoming more robust to approximation or estimation errors. Various theoretical results are established, which include showing on a sample path basis that our family of operators preserve optimality and increase the action gap. Our empirical results illustrate the strong benefits of our family of operators, significantly outperforming the classical Bellman operator and recently proposed operators.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Bellman operator convergence enhancements in reinforcement learning algorithms

    cs.LG 2025-05 reject novelty 4.0 of 10

    A new advantage-weighted Bellman operator is claimed to speed up Q-learning convergence, but the proofs are flawed and experiments lack error bars.

Pith tools