REVIEW 1 cited by
Optimal bounds for bit-sizes of stationary distributions in finite Markov chains
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
An irreducible stochastic matrix with rational entries has a stationary distribution given by a vector of rational numbers. We give an upper bound on the lowest common denominator of the entries of this vector. Bounds of this kind are used to study the complexity of algorithms for solving stochastic mean payoff games. They are usually derived using the Hadamard inequality, but this leads to suboptimal results. We replace the Hadamard inequality with the Markov chain tree formula in order to obtain optimal bounds. We also adapt our approach to obtain bounds on the absorption probabilities of finite Markov chains and on the gains and bias vectors of Markov chains with rewards.
Forward citations
Cited by 1 Pith paper
-
Finite-Time Analysis of Discounted Exponential-Utility Reinforcement Learning
The one- and two-timescale algorithms for discounted exponential-utility RL achieve O~(1/sqrt(n)) finite-time rates under Markovian sampling with parameter-free stepsizes.
Discussion (0). Continue with ORCID to comment.