pith. sign in

arxiv: 1503.07118 · v4 · pith:OLIRXDXBnew · submitted 2015-03-24 · 💻 cs.IT · math.IT· math.PR

On Reverse Pinsker Inequalities

classification 💻 cs.IT math.ITmath.PR
keywords bounddistancemeasuresprobabilitytotalvariationarbitraryfinite
0
0 comments X
read the original abstract

New upper bounds on the relative entropy are derived as a function of the total variation distance. One bound refines an inequality by Verd\'{u} for general probability measures. A second bound improves the tightness of an inequality by Csisz\'{a}r and Talata for arbitrary probability measures that are defined on a common finite set. The latter result is further extended, for probability measures on a finite set, leading to an upper bound on the R\'{e}nyi divergence of an arbitrary non-negative order (including $\infty$) as a function of the total variation distance. Another lower bound by Verd\'{u} on the total variation distance, expressed in terms of the distribution of the relative information, is tightened and it is attained under some conditions. The effect of these improvements is exemplified.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. The Data-Driven Censored Newsvendor Problem

    math.OC 2024-12 unverdicted novelty 6.0

    Derives necessary and sufficient conditions for vanishing regret in the censored data-driven newsvendor under a DRO ambiguity set defined by the max historical order quantity, and proposes a near-optimal adaptive algo...