pith. sign in

arxiv: 1702.03656 · v1 · pith:BS5G4DUGnew · submitted 2017-02-13 · 💻 cs.IT · math.IT· math.ST· stat.TH

Information and estimation in Fokker-Planck channels

classification 💻 cs.IT math.ITmath.STstat.TH
keywords informationestimation-theoreticfokker-planckquantitiesappropriatebruijnchannelchannels
0
0 comments X
read the original abstract

We study the relationship between information- and estimation-theoretic quantities in time-evolving systems. We focus on the Fokker-Planck channel defined by a general stochastic differential equation, and show that the time derivatives of entropy, KL divergence, and mutual information are characterized by estimation-theoretic quantities involving an appropriate generalization of the Fisher information. Our results vastly extend De Bruijn's identity and the classical I-MMSE relation.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.