pith. sign in

arxiv: cond-mat/0604027 · v1 · submitted 2006-04-03 · ❄️ cond-mat.stat-mech

Entropic criterion for model selection

classification ❄️ cond-mat.stat-mech
keywords criterionselectionentropymodelpriorrelativeusuallyaccording
0
0 comments X
read the original abstract

Model or variable selection is usually achieved through ranking models according to the increasing order of preference. One of methods is applying Kullback-Leibler distance or relative entropy as a selection criterion. Yet that will raise two questions, why uses this criterion and are there any other criteria. Besides, conventional approaches require a reference prior, which is usually difficult to get. Following the logic of inductive inference proposed by Caticha, we show relative entropy to be a unique criterion, which requires no prior information and can be applied to different fields. We examine this criterion by considering a physical problem, simple fluids, and results are promising.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.