pith. sign in

arxiv: 0806.1291 · v2 · pith:4N7JBM7Vnew · submitted 2008-06-07 · 🧮 math.PR

Computing expected transition events in reducible Markov chains

classification 🧮 math.PR
keywords chainseventsreduciblestatetransitionbehaviorexpectedexpression
0
0 comments X
read the original abstract

We present a closed-form, computable expression for the expected number of times any transition event occurs during the transient phase of a reducible Markov chain. Examples of events include time to absorption, number of visits to a state, traversals of a particular transition, loops from a state to itself, and arrivals to a state from a particular subset of states. We give an analogous expression for time-average events, which describe the steady-state behavior of reducible chains as well as the long-term behavior of irreducible chains.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.