arxiv: 1102.4794 · v2 · pith:B7XIHRZ2new · submitted 2011-02-23 · 💻 cs.IT · math.IT· nlin.SI

Information Loss in Static Nonlinearities

Bernhard C. Geiger , Christian Feldbauer , Gernot Kubin This is my paper

classification 💻 cs.IT math.ITnlin.SI

keywords informationlosssystemapplicationboundsconditionalconsideredcontinuous

0 comments p. Extension

Add this Pith Number to your LaTeX paper

\usepackage{pith}
\pithnumber{B7XIHRZ2}

Prints a linked pith:B7XIHRZ2 badge after your title and writes the identifier into PDF metadata. Compiles on arXiv with no extra files. Learn more

read the original abstract

In this work, conditional entropy is used to quantify the information loss induced by passing a continuous random variable through a memoryless nonlinear input-output system. We derive an expression for the information loss depending on the input density and the nonlinearity and show that the result is strongly related to the non-injectivity of the considered system. Tight upper bounds are presented, which can be evaluated with less difficulty than a direct evaluation of the information loss, which involves the logarithm of a sum. Application of our results is illustrated on a set of examples.

This paper has not been read by Pith yet.

Information Loss in Static Nonlinearities

discussion (0)