pith. sign in

arxiv: 1311.2196 · v3 · pith:QR7CMJ25new · submitted 2013-11-09 · 🧮 math.PR

Reduction of Markov chains with two-time-scale state transitions

classification 🧮 math.PR
keywords chainstatemarkovspacelambdachainsinftyreduced
0
0 comments X
read the original abstract

In this paper, we consider a general class of two-time-scale Markov chains whose transition rate matrix depends on a parameter $\lambda>0$. We assume that some transition rates of the Markov chain will tend to infinity as $\lambda\rightarrow\infty$. We divide the state space of the Markov chain $X$ into a fast state space and a slow state space and define a reduced chain $Y$ on the slow state space. Our main result is that the distribution of the original chain $X$ will converge in total variation distance to that of the reduced chain $Y$ uniformly in time $t$ as $\lambda\rightarrow\infty$.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.