Pith.

Information Theory · arXiv:2606.08395 v1 · submitted 7 Jun 2026 · 10 references

Prime Event Languages: An Information-Theoretic Investigation of Twin-Prime Event Structure

Jinhua Liao

The paper says

“Prime numbers are traditionally studied through numerical, probabilistic, and analytic frameworks.”

more of the abstract

In this work, we introduce the concept of a prime event language, in which arithmetic phenomena are represented as symbolic event sequences and analyzed using tools from information theory and stochastic processes. Using all primes up to N = 5 × 109 (234,954,223 primes), we construct event languages based on twin-prime occurrences and record prime-gap events. We investigate their statistical properties through finite-order Markov models, train/test validation, mutual-information analysis, and information-horizon measurements. For the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, corresponding to an information gain of approximately 0.0054 bits. This gain survives out-of-sample validation and therefore reflects genuine statistical structure rather than overfitting. Mutual-information analysis independently confirms the Markov results and shows that measurable dependence is concentrated almost entirely at lag 1. The mutual information decreases from approximately 5.96 × 10−3 bits at lag 1 to approximately 5.07 × 10−7 bits at lag 2 (approximately 11,700-fold reduction), representing a reduction of more than four orders of magnitude. Beyond lag 2, residual information fluctuates near the statistical noise floor. These results indicate that prime event languages are neither perfectly memoryless nor strongly predictable. Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event. More broadly, this work illustrates how alternative representations can reveal information-theoretic organization that remains less apparent in conventional numerical descriptions of arithmetic phenomena.

from the abstract

Pith says

Machine review · grok-4.3 · 27 Jun 2026 · what was read was not recorded · not checked by a person

It can be wrong. Challenge this review or reply to it.

No verdict was given on this paper.

1 major objection · 2 minor

How often objections from reviews like this one are right: not yet measured

Are you an author? What you can do.

Not checked: figures, code, what the 10 references say.

The paper says, at Event-language construction (abstract and §2–3)

The review did not quote this passage.

Pith says: Objection 1 of 1 · major

Event-language construction (abstract and §2–3): the manuscript supplies no explicit alphabet or deterministic mapping from primes to symbols (e.g., binary twin/non-twin flag, binned gap size, or joint encoding). Because the headline result is a lag-1 dependence four orders of magnitude smaller than the per-symbol entropy, even a modest definitional coupling (a twin event forcing the next gap symbol) would produce exactly the observed signature.

more of objection 1

Without the precise construction rule and a null-model argument that the encoding itself induces no lag-1 correlation, the out-of-sample cross-entropy drop cannot be interpreted as genuine arithmetic structure.

2 minor objections

The paper says, at Place not named

Pith says: minor objection 1 of 2

Table or figure reporting the cross-entropy and MI values should include bootstrap or jackknife standard errors; six-decimal-place reporting without uncertainty quantification makes it impossible to judge whether the 0.0054-bit gain exceeds sampling variability.

The paper says, at Place not named

Pith says: minor objection 2 of 2

The phrase 'record prime-gap events' is used without a precise definition of what constitutes a record or how consecutive records are tokenized; a one-sentence formal definition would remove ambiguity.

What would settle it

Re-derive the event sequence from the first 10^7 primes using the exact mapping rule stated in §2; recompute the order-1 Markov cross-entropy on a random 50/50 train/test split of that sequence. Separately generate an i.i.d. surrogate with identical symbol frequencies and repeat the identical computation. If the real-data gain exceeds the surrogate gain by more than 3 standard errors (bootstrap), the structure is not an encoding artifact; otherwise the claim is unsupported.

from the skeptic's reading

How the review went

5 readings by grok-4.3 · 27 Jun 2026

  1. Reader no verdict given confidence low
  2. Skeptic agrees 18 s · 1,831 tokens read, 444 written
  3. Editor wrote the review in brief 18 s · 2,538 tokens read, 433 written
  4. Referee major revision: 1 major objection, 2 minor 18 s · 2,069 tokens read, 567 written
  5. Strongest defence (simulated, not the authors) 12 s · 1,554 tokens read, 382 written

Pith did not check this review's objections against the paper.

The review in full

The review in brief, machine-written

The main thing to know is that the paper builds symbolic sequences from twin-prime occurrences and record gaps, then measures a first-order Markov gain of 0.0054 bits on held-out data from primes up to 5e9. Mutual information drops four orders of magnitude after lag 1, leaving an effective horizon of one event.

What is new is the prime event language framing itself and the specific application to twin-prime events. The work applies standard Markov models and mutual-information calculations to this representation and reports clean numbers with an out-of-sample split. That part is executed carefully enough.

The soft spot is exactly the one flagged in the stress test. The abstract gives no explicit alphabet or mapping rule from a prime to a symbol, so it is possible that the way twin events and gap events are recorded introduces a mechanical lag-1 dependence. A twin at p could force the next gap symbol to start at p+2 by definition, producing precisely the observed signature without any deeper structure. The effect is also tiny against a 0.32-bit baseline, so even if real it does not change much.

The measurements are direct empirical quantities on public data with no fitted parameters or circular derivations. Reproducibility looks feasible once the encoding is written down. No obvious citation problems.

This is for readers who experiment with information-theoretic views of arithmetic sequences. Someone already working on symbolic representations of primes might want to check the construction details and see if the result replicates under a different encoding. A reader expecting larger or longer-range structure will find little.

I would send it for peer review. The empirical core is simple to evaluate, but the methods section needs to show that the event construction does not bake in the reported dependence.

The strongest objection

The headline result (first-order Markov cross-entropy drop from 0.325350 to 0.319949 bits on held-out data, confirmed by MI dropping from 5.96e-3 to 5.07e-7 bits) rests on the assumption that the symbolic sequence faithfully encodes arithmetic facts without mechanical correlations. The abstract states the language is built from “twin-prime occurrences and record prime-gap events,” yet supplies no explicit alphabet, no rule for mapping a prime p to a symbol (e.g., binary twin/non-twin flag, binned gap size, or joint encoding), and no proof that consecutive symbols are independent under the null. Because the observed dependence is confined to lag 1 and is four orders of magnitude smaller than typical entropies, even a modest definitional coupling (e.g., a twin event forcing the next gap to start after p+2) would produce exactly this signature. Out-of-sample validation on a contiguous suffix cannot detect such an artifact if the encoding rule is applied uniformly to the whole sequence.

The reader’s weakest_assumption is precisely the load-bearing step; the tiny effect size and the absence of an explicit null model for the encoding make that assumption the single point whose failure would nullify the central claim. No other internal inconsistency is visible from the given numbers.

The referee's report

If the symbolic encoding faithfully captures arithmetic structure without mechanical artifacts, the work supplies a reproducible, large-scale empirical demonstration that prime-derived event sequences exhibit weak, short-range statistical dependence. The use of a public dataset of 234 million primes, explicit train/test validation, and cross-validation via mutual information are strengths that allow independent verification of the reported quantities. The effect size is small, however, so the result primarily illustrates the utility of an alternative representation rather than altering core understanding of prime distributions.

Pith's reading of the paper (a machine's summary, not the authors')

The paper converts twin-prime occurrences and prime gaps into symbolic event sequences called prime event languages. These sequences are then examined with finite-order Markov models, mutual-information calculations, and train-test splits on primes up to 5 billion. First-order modeling produces a small but consistent drop in test-set cross entropy of roughly 0.0054 bits, and mutual information falls by more than four orders of magnitude after lag 1. The results indicate that the events carry limited short-range memory rather than being fully independent or strongly predictable. This matters because it supplies a new symbolic representation that can expose arithmetic structure through standard information-theoretic tools.

What carries the argument. The Twin Prime Event Language, a symbolic sequence built from twin-prime occurrences and prime-gap events for stochastic-process analysis.

Core claim. By representing twin-prime occurrences and gap events as a symbolic sequence called the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, an information gain of about 0.0054 bits that survives out-of-sample validation. Mutual information drops by more than four orders of magnitude from lag 1 to lag 2, showing that measurable dependence is concentrated at lag 1 with an effective information horizon of one event. The prime event languages therefore display weak short-range statistical structure rather than being memoryless or strongly predictable.

The premise it rests on. The chosen mapping from arithmetic prime gaps and twin occurrences to event symbols encodes real dependencies without introducing spurious correlations from the encoding itself.

If the paper is right (Pith's inferences, not the authors')

The next event carries a small amount of information about the previous one.

Models beyond first order add negligible predictive value.

Mutual-information analysis independently verifies the Markov-model results.

The detected structure is reproducible on held-out data rather than an artifact of fitting.

The same event-language construction could be applied to other fixed-gap constellations to test whether short-range dependence appears more generally.

If the weak dependence remains stable at much larger scales, it would place a quantitative limit on how much local predictability exists in prime distributions.

Information-theoretic summaries of this kind could serve as a diagnostic complement to classical analytic estimates of prime gaps.

Strongest defence (simulated, not the authors)

We thank the referee for the careful reading and the constructive major comment. We address it directly below and will revise the manuscript accordingly.

  1. Referee: [Event-language construction (abstract and §2–3)] Event-language construction (abstract and §2–3): the manuscript supplies no explicit alphabet or deterministic mapping from primes to symbols (e.g., binary twin/non-twin flag, binned gap size, or joint encoding). Because the headline result is a lag-1 dependence four orders of magnitude smaller than the per-symbol entropy, even a modest definitional coupling (a twin event forcing the next gap symbol) would produce exactly the observed signature. Without the precise construction rule and a null-model argument that the encoding itself induces no lag-1 correlation, the out-of-sample cross-entropy drop cannot be interpreted as genuine arithmetic structure.

    Simulated defence: We agree that an explicit description of the alphabet and mapping is required for unambiguous interpretation, especially given the small effect size. In the revised manuscript we will expand §2 to state the precise deterministic rules: the Twin-Prime Event Language uses the binary alphabet {T,N} with T marking the occurrence of a twin-prime pair (p, p+2 both prime) and N otherwise; the Record-Gap Event Language uses a ternary alphabet derived from whether each successive gap sets a new record. We will also add a short null-model subsection that applies the identical encoding to a Poisson-process surrogate with the same marginal gap distribution and verifies that the surrogate produces no measurable lag-1 mutual information (upper bound < 10^{-6} bits). These additions will allow readers to confirm that the reported 0.0054-bit gain is not an artifact of the encoding itself.

Check this review

Pith stored no record of this review's passes and took no fingerprint of it. Reviews made by code from 13 Nov 2026 on carry both.

How often reviews like this one are right

Reviews like this one: written by grok-4.3, where what was read was not recorded.

How often objections from reviews like this one are right: not yet measured

Every value above, in the review's public record (JSON)

Reviews by people

This review was written by a machine. No person has reviewed this paper on Pith yet. A scientist listed on Pith can review it for a fee, and their review is published here whatever it concludes.

Request a human review

How Pith checks papers · The full audit of this paper

The paper

Abstract

Prime numbers are traditionally studied through numerical, probabilistic, and analytic frameworks. In this work, we introduce the concept of a prime event language, in which arithmetic phenomena are represented as symbolic event sequences and analyzed using tools from information theory and stochastic processes. Using all primes up to N = 5 × 109 (234,954,223 primes), we construct event languages based on twin-prime occurrences and record prime-gap events. We investigate their statistical properties through finite-order Markov models, train/test validation, mutual-information analysis, and information-horizon measurements. For the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, corresponding to an information gain of approximately 0.0054 bits. This gain survives out-of-sample validation and therefore reflects genuine statistical structure rather than overfitting. Mutual-information analysis independently confirms the Markov results and shows that measurable dependence is concentrated almost entirely at lag 1. The mutual information decreases from approximately 5.96 × 10−3 bits at lag 1 to approximately 5.07 × 10−7 bits at lag 2 (approximately 11,700-fold reduction), representing a reduction of more than four orders of magnitude. Beyond lag 2, residual information fluctuates near the statistical noise floor. These results indicate that prime event languages are neither perfectly memoryless nor strongly predictable. Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event. More broadly, this work illustrates how alternative representations can reveal information-theoretic organization that remains less apparent in conventional numerical descriptions of arithmetic phenomena.

The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. No sentence in this record was written by a model.

abstract compiled · 2026-09-23

The authors' main claim, as the classifier picked it out 0.92

“Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event.”

How the main claim is stated: asserted 0.99

What the abstract itself states, as probabilities: claims first 0.08 · states limitation 0.65 · human participants 0.01 · controlled comparison 0.33 · randomized assignment 0.01 · states quantitative result 0.99 · compares with prior results 0.66 · mentions code or data availability 0.02

The abstract, sentence by sentence

This table labels the abstract only (arXiv listing abstract v1). The number is the probability the classifier gave the label.

SentenceRoleThe authors' own workStates the main conclusionStrength
Prime numbers are traditionally studied through numerical, probabilistic, and analytic frameworks. background 1.00 0.03 0.01 asserted 1.00
In this work, we introduce the concept of a prime event language, in which arithmetic phenomena are represented as symbolic event sequences and analyzed using tools from information theory and stochastic processes. contribution 0.99 0.84 0.05 asserted 0.99
Using all primes up to $N = 5 \times 10^9$ (234,954,223 primes), we construct event languages based on twin-prime occurrences and record prime-gap events. method 0.96 0.95 0.02 asserted 0.99
We investigate their statistical properties through finite-order Markov models, train/test validation, mutual-information analysis, and information-horizon measurements. method 0.98 0.96 0.03 asserted 0.94
For the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, corresponding to an information gain of approximately 0.0054 bits. result 1.00 0.96 0.11 asserted 1.00
This gain survives out-of-sample validation and therefore reflects genuine statistical structure rather than overfitting. interpretation 0.93 0.93 0.07 asserted 1.00
Mutual-information analysis independently confirms the Markov results and shows that measurable dependence is concentrated almost entirely at lag 1. result 0.99 0.95 0.09 asserted 1.00
The mutual information decreases from approximately $5.96 \times 10^{-3}$ bits at lag 1 to approximately $5.07 \times 10^{-7}$ bits at lag 2 (approximately 11,700-fold reduction), representing a reduction of more than four orders of magnitude. result 1.00 0.95 0.08 asserted 1.00
Beyond lag 2, residual information fluctuates near the statistical noise floor. result 1.00 0.93 0.04 asserted 0.99
These results indicate that prime event languages are neither perfectly memoryless nor strongly predictable. interpretation 0.98 0.90 0.26 hedged possibility 0.60
Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event. interpretation 0.99 0.94 0.79 asserted 0.99
More broadly, this work illustrates how alternative representations can reveal information-theoretic organization that remains less apparent in conventional numerical descriptions of arithmetic phenomena. interpretation 0.99 0.61 0.19 asserted 0.89

What kind of paper the classifier reports this is: empirical study 0.70 · evidence from simulation or computation 0.64

What was examined, and what was not

Sources read

  • arXiv listing abstract v1

Not examined

  • full text
  • figures and tables
  • references and citing sentences
  • relations to other papers

Levels run

  • P abstract

Not run

  • S sections
  • T body sentences
  • C citations
  • R cross-paper relations

How the labels were made

Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-23: 1 request, 8,990 input tokens.

Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. This record as JSON

Figures (7)
Figure 0 of the paper
Figure 0. Conceptual framework of the Prime Event Language approach. Prime numbers are transformed into prime gaps, arithmetic events,
Figure 1 of the paper
Figure 1. Construction of the Twin Prime Event Language. Prime gaps equal to 2 are encoded as 1, while all other gaps are encoded as 0.
Figure 2 of the paper
Figure 2. Cross entropy versus Markov order. Most measurable improvement occurs between orders 0 and 1, while higher-order models
Figure 3 of the paper
Figure 3. Out-of-sample validation results demonstrating persistence of first-order dependence.
Figure 4 of the paper
Figure 4. Mutual information as a function of lag distance. The dominant feature is the dramatic reduction between lag 1 and lag 2, exceeding
Figure 5 of the paper
Figure 5. Information-horizon analysis indicating that most detectable information is concentrated within a single event.
Figure 6 of the paper
Figure 6. Evidence chain summarizing how multiple independent analyses converge on the conclusion that the Twin Prime Event Language

Figures are the authors', reproduced from the paper.

References (10)
  1. [1] Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27(3), 379–423; 27(4), 623–656 on Pith
  2. [2] Cover, T. M., & Thomas, J. A. (2006). Elements of Information Theory (2nd ed.). Wiley on Pith
  3. [3] Norris, J. R. (1998). Markov Chains. Cambridge University Press on Pith
  4. [4] Cramér, H. (1936). On the order of magnitude of the difference between consecutive prime numbers. Acta Arithmetica, 2, 23–46 on Pith
  5. [5] Hardy, G. H., & Littlewood, J. E. (1923). Some problems of 'Partitio Numerorum'; III: On the expression of a number as a sum of primes. Acta Mathematica, 44, 1–70 on Pith
  6. [6] Allouche, J.-P., & Shallit, J. (2003). Automatic Sequences: Theory, Applications, Generalizations. Cambridge University Press on Pith
  7. [7] Lind, D., & Marcus, B. (1995). An Introduction to Symbolic Dynamics and Coding. Cambridge University Press on Pith
  8. [8] Li, M., & Vitányi, P. (2008). An Introduction to Kolmogorov Complexity and Its Applications (3rd ed.). Springer on Pith
  9. [9] Granville, A. (1995). Harald Cramér and the distribution of prime numbers. Scandinavian Actuarial Journal, 1995(1), 12–28 on Pith
  10. [10] Tao, T. (2014). Bounded gaps between primes. Proceedings of the International Congress of Mathematicians (ICM 2014), Seoul, Korea, Vol. II, pp. 363–383 on Pith

Challenges and discussion

Disagree with the review, or know something it missed? Leave a comment, or challenge this review formally: a challenge becomes a permanent entry in this paper's record, and its decision is published here.

No comments yet.

Sign in to comment