pith. sign in

arxiv: 1510.01844 · v4 · pith:V36ZKACRnew · submitted 2015-10-07 · 💻 cs.IT · math.IT· math.PR· math.ST· stat.TH

Linear Bounds between Contraction Coefficients for f-Divergences

classification 💻 cs.IT math.ITmath.PRmath.STstat.TH
keywords contractioncoefficientsdivergencesdivergenceboundcoefficientcalledchannels
0
0 comments X
read the original abstract

Data processing inequalities for $f$-divergences can be sharpened using constants called "contraction coefficients" to produce strong data processing inequalities. For any discrete source-channel pair, the contraction coefficients for $f$-divergences are lower bounded by the contraction coefficient for $\chi^2$-divergence. In this paper, we elucidate that this lower bound can be achieved by driving the input $f$-divergences of the contraction coefficients to zero. Then, we establish a linear upper bound on the contraction coefficients for a certain class of $f$-divergences using the contraction coefficient for $\chi^2$-divergence, and refine this upper bound for the salient special case of Kullback-Leibler (KL) divergence. Furthermore, we present an alternative proof of the fact that the contraction coefficients for KL and $\chi^2$-divergences are equal for a Gaussian source with an additive Gaussian noise channel (where the former coefficient can be power constrained). Finally, we generalize the well-known result that contraction coefficients of channels (after extremizing over all possible sources) for all $f$-divergences with non-linear operator convex $f$ are equal. In particular, we prove that the so called "less noisy" preorder over channels can be equivalently characterized by any non-linear operator convex $f$-divergence.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Local Information-Theoretic Security via Euclidean Geometry

    cs.IT 2025-10 unverdicted novelty 6.0

    The work derives an approximate local secrecy capacity and defines secret local contraction coefficients as largest generalized eigenvalues of channel matrix pencils, obtained via local Euclidean geometry approximatio...