REVIEW 2 cited by
REGAL: A Regularization based Algorithm for Reinforcement Learning in Weakly Communicating MDPs
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We provide an algorithm that achieves the optimal regret rate in an unknown weakly communicating Markov Decision Process (MDP). The algorithm proceeds in episodes where, in each episode, it picks a policy using regularization based on the span of the optimal bias vector. For an MDP with S states and A actions whose optimal bias vector has span bounded by H, we show a regret bound of ~O(HSpAT). We also relate the span to various diameter-like quantities associated with the MDP, demonstrating how our results improve on previous regret bounds.
Forward citations
Cited by 2 Pith papers
-
Sharp Gap-Dependent Variance-Aware Regret Bounds for Tabular MDPs
The MVP algorithm achieves a gap-dependent variance-aware regret bound using a new conditional total variance measure, and a matching lower bound shows this variance dependence is necessary.
-
Non-Stationary Restless Multi-Armed Bandits with Provable Guarantee
First claimed regret bound for non-stationary restless multi-armed bandits via per-arm sliding-window optimism, but it holds for a relaxed regret measure and the proof contains gaps.
Discussion (0). Sign in to comment.