Information and estimation in Fokker-Planck channels
classification
💻 cs.IT
math.ITmath.STstat.TH
keywords
informationestimation-theoreticfokker-planckquantitiesappropriatebruijnchannelchannels
read the original abstract
We study the relationship between information- and estimation-theoretic quantities in time-evolving systems. We focus on the Fokker-Planck channel defined by a general stochastic differential equation, and show that the time derivatives of entropy, KL divergence, and mutual information are characterized by estimation-theoretic quantities involving an appropriate generalization of the Fisher information. Our results vastly extend De Bruijn's identity and the classical I-MMSE relation.
This paper has not been read by Pith yet.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.