pith. sign in

arxiv: 1302.4383 · v1 · pith:NG7KLASHnew · submitted 2013-02-18 · ⚛️ physics.data-an · cond-mat.stat-mech· cs.CL

Explaining Zipf's Law via Mental Lexicon

classification ⚛️ physics.data-an cond-mat.stat-mechcs.CL
keywords textzipflexiconmentalapplicabilityaprioriassumingauthor
0
0 comments X
read the original abstract

The Zipf's law is the major regularity of statistical linguistics that served as a prototype for rank-frequency relations and scaling laws in natural sciences. Here we show that the Zipf's law -- together with its applicability for a single text and its generalizations to high and low frequencies including hapax legomena -- can be derived from assuming that the words are drawn into the text with random probabilities. Their apriori density relates, via the Bayesian statistics, to general features of the mental lexicon of the author who produced the text.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.