Upper Bounds on the Relative Entropy and R\'enyi Divergence as a Function of Total Variation Distance for Finite Alphabets
classification
💻 cs.IT
math.ITmath.PR
keywords
bounddistancefunctiontotaluppervariationdivergenceentropy
read the original abstract
A new upper bound on the relative entropy is derived as a function of the total variation distance for probability measures defined on a common finite alphabet. The bound improves a previously reported bound by Csisz\'ar and Talata. It is further extended to an upper bound on the R\'enyi divergence of an arbitrary non-negative order (including $\infty$) as a function of the total variation distance.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
Gradient-Free Warm-Start Library Recovery: an Amortized-Regret Separation
A gradient-free warm-start library learner attains an amortized-regret separation on recurring-regime streams with recognition cost independent of dimension D.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.