pith. sign in

arxiv: 1011.0723 · v1 · pith:GOIQNVNHnew · submitted 2010-11-02 · ⚛️ physics.data-an · cond-mat.stat-mech· stat.ME

Entropic Inference

classification ⚛️ physics.data-an cond-mat.stat-mechstat.ME
keywords inferenceentropybayesianentropicmaximumrelativeagentsarguments
0
0 comments X p. Extension
pith:GOIQNVNH Add to your LaTeX paper What is a Pith Number?
\usepackage{pith}
\pithnumber{GOIQNVNH}

Prints a linked pith:GOIQNVNH badge after your title and writes the identifier into PDF metadata. Compiles on arXiv with no extra files. Learn more

read the original abstract

In this tutorial we review the essential arguments behing entropic inference. We focus on the epistemological notion of information and its relation to the Bayesian beliefs of rational agents. The problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), includes as special cases both MaxEnt and Bayes' rule, and therefore unifies the two themes of these workshops -- the Maximum Entropy and the Bayesian methods -- into a single general inference scheme.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Information as Maximum-Caliber Deviation: A bridge between Integrated Information Theory and the Free Energy Principle

    q-bio.NC 2026-05 unverdicted novelty 6.0

    Information defined as maximum-caliber deviation derives IIT 3.0 cause-effect repertoires from constrained entropy maximization and equates to prediction error under CLT and LDT.