pith. sign in

arxiv: math/0502484 · v1 · submitted 2005-02-23 · 🧮 math.PR

Universal finitary codes with exponential tails

classification 🧮 math.PR
keywords finitaryhomomorphismbernoullicodingentropyexponentialfinite-alphabetlength
0
0 comments X
read the original abstract

In 1977, Keane and Smorodinsky showed that there exists a finitary homomorphism from any finite-alphabet Bernoulli process to any other finite-alphabet Bernoulli process of strictly lower entropy. In 1996, Serafin proved the existence of a finitary homomorphism with finite expected coding length. In this paper, we construct such a homomorphism in which the coding length has exponential tails. Our construction is source-universal, in the sense that it does not use any information on the source distribution other than the alphabet size and a bound on the entropy gap between the source and target distributions. We also indicate how our methods can be extended to prove a source-specific version of the result for Markov chains.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.