RECORD
Minimum MS. E. Gerber's Lemma
Information Theory · Submitted 31 May 2015
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim We show that in many cases our bound is tighter than the one obtained from Mrs. Gerber's Lemma.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Mrs. Gerber's Lemma lower bounds the entropy at the output of a binary symmetric channel in terms of the entropy of the input process. In this paper, we lower bound the output entropy via a different measure of input uncertainty, pertaining to the minimum mean squared error (MMSE) prediction cost of the input process. We show that in many cases our bound is tighter than the one obtained from Mrs. Gerber's Lemma. As an application, we evaluate the bound for binary hidden Markov processes, and obtain new estimates for the entropy rate.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Mrs. | background 0.96 | 0.02 | 0.01 | unclear 1.00 |
| s1 | Gerber's Lemma lower bounds the entropy at the output of a binary symmetric channel in terms of the entropy of the input process. | background 1.00 | 0.05 | 0.11 | asserted 1.00 |
| s2 | In this paper, we lower bound the output entropy via a different measure of input uncertainty, pertaining to the minimum mean squared error (MMSE) prediction cost of the input process. | contribution 0.81 | 0.93 | 0.27 | asserted 1.00 |
| s3 | We show that in many cases our bound is tighter than the one obtained from Mrs. Gerber's Lemma. | result 0.97 | 0.94 | 0.51 | asserted 0.94 |
| s4 | As an application, we evaluate the bound for binary hidden Markov processes, and obtain new estimates for the entropy rate. | contribution 0.58 | 0.96 | 0.10 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Mrs. Gerber's Lemma lower bounds the entropy at the output of a binary symmetric channel in terms of the entropy of the input process. In this paper, we lower bound the output entropy via a different measure of input uncertainty, pertaining to the minimum mean squared error (MMSE) prediction cost of the input process. We show that in many cases our bound is tighter than the one obtained from Mrs. Gerber's Lemma. As an application, we evaluate the bound for binary hidden Markov processes, and obtain new estimates for the entropy rate.
Human review
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.