On the Polarization of R\'{e}nyi Entropy

Cong Ling; Ling Liu; Mengfan Zheng

arxiv: 1907.06423 · v1 · pith:HSRS3F3Hnew · submitted 2019-07-15 · 💻 cs.IT · math.IT

On the Polarization of R\'{e}nyi Entropy

Mengfan Zheng , Ling Liu , Cong Ling This is my paper

Pith reviewed 2026-05-24 21:17 UTC · model grok-4.3

classification 💻 cs.IT math.IT

keywords Rényi entropypolarizationconditional entropysynthetic sub-channelsextremal stateschannel combininginformation measures

0 comments

The pith

Conditional Rényi entropies of different orders can assign opposite extremal states to the same synthetic sub-channel.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This paper extends polarization analysis from Shannon entropy to Rényi entropy. It establishes that the same synthetic sub-channel can be extremal in opposite directions depending on the order of the conditional Rényi entropy. This occurs because the behavior at the probability pair level varies with the entropy order. A reader would care as it provides a more detailed understanding of how polarization works beyond average measures.

Core claim

Existing polarization theories have mostly been concerned with Shannon's information measures. This work extends them to Rényi entropy and shows that under conditional Rényi entropies of different orders, the same synthetic sub-channel may exhibit opposite extremal states. This result reveals more insights into the polarization phenomenon on the micro scale rather than on the average scale.

What carries the argument

The polarization transform of channel combining and splitting applied to conditional Rényi entropy of order alpha, which determines whether a synthetic sub-channel reaches an extremal state.

Load-bearing premise

The chosen definitions of conditional Rényi entropy of order alpha preserve the recursive structure of channel combining and splitting used in polarization.

What would settle it

Compute the polarized versions of a binary symmetric channel under conditional Rényi entropy of order 2 and order infinity and check whether any sub-channel reaches the 0-entropy state for one order and the maximum-entropy state for the other.

read the original abstract

Existing polarization theories have mostly been concerned with Shannon's information measures, such as Shannon entropy and mutual information, and some related measures such as the Bhattacharyya parameter. In this work, we extend polarization theories to a more general information measure, namely, the R\'{e}nyi entropy. Our study shows that under conditional R\'{e}nyi entropies of different orders, the same synthetic sub-channel may exhibit opposite extremal states. This result reveals more insights into the polarization phenomenon on the micro scale (probability pairs) rather than on the average scale.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

The paper extends polarization to Rényi entropy and reports opposite extremal behavior on the same synthetic channels under different orders.

read the letter

The central new element is the move from Shannon entropy to Rényi entropy in the polarization setting, together with the observation that one synthetic sub-channel can be extremal in opposite directions when evaluated under conditional Rényi entropies of different orders. That micro-scale point on probability pairs is not in the earlier Shannon-focused polarization work they cite. The authors carry out the extension and illustrate the phenomenon with the usual Arikan-style combining and splitting steps applied to the new measure. Credit is due for making the claim explicit and for framing it as an insight at the level of individual channels rather than averages. The main soft spot is exactly the one flagged in the stress-test note: the result stands only if the chosen definition of conditional Rényi entropy preserves the precise recursion that maps the combined channel back to the split pair. Several inequivalent extensions of conditional Rényi entropy exist, and only some of them will close under the polarization identities. The abstract does not display the required functional identity or the explicit definition, so the full text must be checked to confirm that the opposite-extremal states actually follow from the recursion rather than from an ad-hoc choice of order. If the identity holds, the observation is solid; if not, the claimed insight reduces to a property of the measure rather than a property of polarization. This is a paper for readers already working on polarization or on generalized entropies in information theory. Someone who needs to know how Rényi measures behave under channel synthesis will find the concrete claim useful. It is coherent enough on its own terms to merit a serious referee, even if the recursion check turns out to require revision. I would send it to review.

Referee Report

2 major / 2 minor

Summary. The manuscript extends polarization theory from Shannon entropy to Rényi entropy. It claims that, under conditional Rényi entropies of different orders, the same synthetic sub-channels (produced via Arikan-style combining and splitting) can exhibit opposite extremal states, thereby providing micro-scale insights into polarization at the level of probability pairs rather than averages.

Significance. If the central claim holds, the work supplies a finer-grained view of polarization that is not visible under Shannon entropy alone. The micro-scale analysis is a potential strength, but its value hinges on whether the chosen conditional Rényi definitions preserve the functional recursions required for the combining/splitting operations.

major comments (2)

[Definitions section] Definitions section (conditional Rényi entropy): the manuscript adopts a particular extension of conditional Rényi entropy but does not verify that this definition satisfies the required recursion relating the entropy of the combined channel to the entropies of the two synthetic sub-channels. Without this identity, the observed opposite extremal states cannot be attributed to polarization in the usual sense.
[Main result] Main result (opposite extremal states): the claim that the same sub-channel can be extremal in opposite directions for different orders rests on the recursion being preserved; the provided abstract and high-level argument do not contain an explicit derivation showing that the extremal behavior follows from the paper's own equations rather than from the post-hoc choice of orders.

minor comments (2)

[Abstract] The abstract refers to 'extremal states' without defining the precise criterion (e.g., whether a channel is declared good/bad by a threshold on the conditional Rényi entropy or by convergence to 0/1).
[Notation] Notation for conditional Rényi entropy of order α should be compared explicitly with the several inequivalent definitions already present in the literature to avoid ambiguity.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the detailed review and for highlighting the need for explicit verification of the recursion and derivation of the main result. We address each major comment below and will revise the manuscript accordingly to strengthen the presentation.

read point-by-point responses

Referee: [Definitions section] Definitions section (conditional Rényi entropy): the manuscript adopts a particular extension of conditional Rényi entropy but does not verify that this definition satisfies the required recursion relating the entropy of the combined channel to the entropies of the two synthetic sub-channels. Without this identity, the observed opposite extremal states cannot be attributed to polarization in the usual sense.

Authors: We agree that an explicit verification of the recursion identity was omitted from the definitions section. In the revised version we will insert a short lemma immediately after the definition of conditional Rényi entropy that derives the required functional recursion for the chosen extension under Arikan combining and splitting. This will confirm that the polarization framework applies directly to the synthetic sub-channels and that the observed opposite extremal states are indeed a consequence of the polarization process rather than an artifact of the definition. revision: yes
Referee: [Main result] Main result (opposite extremal states): the claim that the same sub-channel can be extremal in opposite directions for different orders rests on the recursion being preserved; the provided abstract and high-level argument do not contain an explicit derivation showing that the extremal behavior follows from the paper's own equations rather than from the post-hoc choice of orders.

Authors: We accept that the manuscript would benefit from an explicit step-by-step derivation connecting the recursion to the opposite extremal behavior. We will expand the main-result section (and the accompanying probability-pair analysis) to include a direct derivation that starts from the recursion identity, substitutes the expressions for the two synthetic sub-channels, and shows how the sign of the difference in conditional Rényi entropies reverses when the order α crosses a critical value. This will make clear that the phenomenon follows from the paper's own equations. revision: yes

Circularity Check

0 steps flagged

No significant circularity; derivation is an observational extension

full rationale

The paper's central claim is an empirical observation that the same synthetic sub-channels exhibit opposite extremal behavior when evaluated under conditional Rényi entropies of differing orders. No equations, definitions, or self-citations are supplied in the abstract or reader summary that would allow a reduction of any 'prediction' to a fitted input or to a self-referential definition. The extension from Shannon polarization is presented as a direct application of existing combining/splitting recursions to a generalized entropy measure; absent any quoted step that forces the result by construction, the work is self-contained against external benchmarks and receives the default non-circularity finding.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

Abstract-only review; the extension presupposes that conditional Rényi entropy satisfies the same combining and splitting recursions as Shannon entropy and that extremal states are defined analogously.

axioms (1)

domain assumption Conditional Rényi entropy of order alpha is defined so that the polarization recursions remain valid across alpha values.
Required for the claimed opposite-extremal behavior to be meaningful.

pith-pipeline@v0.9.0 · 5614 in / 1122 out tokens · 17790 ms · 2026-05-24T21:17:24.881347+00:00 · methodology

On the Polarization of R\'{e}nyi Entropy

Core claim

What carries the argument

Load-bearing premise

What would settle it

discussion (0)