Information Theory · arXiv:2606.08395 v1 · submitted 7 Jun 2026 · 10 references
Prime Event Languages: An Information-Theoretic Investigation of Twin-Prime Event Structure
The paper says
“Prime numbers are traditionally studied through numerical, probabilistic, and analytic frameworks.”
more of the abstract
In this work, we introduce the concept of a prime event language, in which arithmetic phenomena are represented as symbolic event sequences and analyzed using tools from information theory and stochastic processes. Using all primes up to N = 5 × 109 (234,954,223 primes), we construct event languages based on twin-prime occurrences and record prime-gap events. We investigate their statistical properties through finite-order Markov models, train/test validation, mutual-information analysis, and information-horizon measurements. For the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, corresponding to an information gain of approximately 0.0054 bits. This gain survives out-of-sample validation and therefore reflects genuine statistical structure rather than overfitting. Mutual-information analysis independently confirms the Markov results and shows that measurable dependence is concentrated almost entirely at lag 1. The mutual information decreases from approximately 5.96 × 10−3 bits at lag 1 to approximately 5.07 × 10−7 bits at lag 2 (approximately 11,700-fold reduction), representing a reduction of more than four orders of magnitude. Beyond lag 2, residual information fluctuates near the statistical noise floor. These results indicate that prime event languages are neither perfectly memoryless nor strongly predictable. Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event. More broadly, this work illustrates how alternative representations can reveal information-theoretic organization that remains less apparent in conventional numerical descriptions of arithmetic phenomena.
from the abstract
Pith says
Machine review · grok-4.3 · 27 Jun 2026 · what was read was not recorded · not checked by a person
It can be wrong. Challenge this review or reply to it.
No verdict was given on this paper.
1 major objection · 2 minor
How often objections from reviews like this one are right: not yet measured
Not checked: figures, code, what the 10 references say.
The paper says, at Event-language construction (abstract and §2–3)
The review did not quote this passage.
Pith says: Objection 1 of 1 · major
Event-language construction (abstract and §2–3): the manuscript supplies no explicit alphabet or deterministic mapping from primes to symbols (e.g., binary twin/non-twin flag, binned gap size, or joint encoding). Because the headline result is a lag-1 dependence four orders of magnitude smaller than the per-symbol entropy, even a modest definitional coupling (a twin event forcing the next gap symbol) would produce exactly the observed signature.
more of objection 1
Without the precise construction rule and a null-model argument that the encoding itself induces no lag-1 correlation, the out-of-sample cross-entropy drop cannot be interpreted as genuine arithmetic structure.
2 minor objections
The paper says, at Place not named
Pith says: minor objection 1 of 2
Table or figure reporting the cross-entropy and MI values should include bootstrap or jackknife standard errors; six-decimal-place reporting without uncertainty quantification makes it impossible to judge whether the 0.0054-bit gain exceeds sampling variability.
The paper says, at Place not named
Pith says: minor objection 2 of 2
The phrase 'record prime-gap events' is used without a precise definition of what constitutes a record or how consecutive records are tokenized; a one-sentence formal definition would remove ambiguity.
What would settle it
Re-derive the event sequence from the first 10^7 primes using the exact mapping rule stated in §2; recompute the order-1 Markov cross-entropy on a random 50/50 train/test split of that sequence. Separately generate an i.i.d. surrogate with identical symbol frequencies and repeat the identical computation. If the real-data gain exceeds the surrogate gain by more than 3 standard errors (bootstrap), the structure is not an encoding artifact; otherwise the claim is unsupported.
from the skeptic's reading
How the review went
5 readings by grok-4.3 · 27 Jun 2026
- Reader no verdict given
- Skeptic agrees
- Editor wrote the review in brief
- Referee major revision: 1 major objection, 2 minor
- Strongest defence (simulated, not the authors)
Pith did not check this review's objections against the paper.
The review in full
The review in brief, machine-written
The main thing to know is that the paper builds symbolic sequences from twin-prime occurrences and record gaps, then measures a first-order Markov gain of 0.0054 bits on held-out data from primes up to 5e9. Mutual information drops four orders of magnitude after lag 1, leaving an effective horizon of one event.
What is new is the prime event language framing itself and the specific application to twin-prime events. The work applies standard Markov models and mutual-information calculations to this representation and reports clean numbers with an out-of-sample split. That part is executed carefully enough.
The soft spot is exactly the one flagged in the stress test. The abstract gives no explicit alphabet or mapping rule from a prime to a symbol, so it is possible that the way twin events and gap events are recorded introduces a mechanical lag-1 dependence. A twin at p could force the next gap symbol to start at p+2 by definition, producing precisely the observed signature without any deeper structure. The effect is also tiny against a 0.32-bit baseline, so even if real it does not change much.
The measurements are direct empirical quantities on public data with no fitted parameters or circular derivations. Reproducibility looks feasible once the encoding is written down. No obvious citation problems.
This is for readers who experiment with information-theoretic views of arithmetic sequences. Someone already working on symbolic representations of primes might want to check the construction details and see if the result replicates under a different encoding. A reader expecting larger or longer-range structure will find little.
I would send it for peer review. The empirical core is simple to evaluate, but the methods section needs to show that the event construction does not bake in the reported dependence.
The strongest objection
The headline result (first-order Markov cross-entropy drop from 0.325350 to 0.319949 bits on held-out data, confirmed by MI dropping from 5.96e-3 to 5.07e-7 bits) rests on the assumption that the symbolic sequence faithfully encodes arithmetic facts without mechanical correlations. The abstract states the language is built from “twin-prime occurrences and record prime-gap events,” yet supplies no explicit alphabet, no rule for mapping a prime p to a symbol (e.g., binary twin/non-twin flag, binned gap size, or joint encoding), and no proof that consecutive symbols are independent under the null. Because the observed dependence is confined to lag 1 and is four orders of magnitude smaller than typical entropies, even a modest definitional coupling (e.g., a twin event forcing the next gap to start after p+2) would produce exactly this signature. Out-of-sample validation on a contiguous suffix cannot detect such an artifact if the encoding rule is applied uniformly to the whole sequence.
The reader’s weakest_assumption is precisely the load-bearing step; the tiny effect size and the absence of an explicit null model for the encoding make that assumption the single point whose failure would nullify the central claim. No other internal inconsistency is visible from the given numbers.
The referee's report
If the symbolic encoding faithfully captures arithmetic structure without mechanical artifacts, the work supplies a reproducible, large-scale empirical demonstration that prime-derived event sequences exhibit weak, short-range statistical dependence. The use of a public dataset of 234 million primes, explicit train/test validation, and cross-validation via mutual information are strengths that allow independent verification of the reported quantities. The effect size is small, however, so the result primarily illustrates the utility of an alternative representation rather than altering core understanding of prime distributions.
Pith's reading of the paper (a machine's summary, not the authors')
The paper converts twin-prime occurrences and prime gaps into symbolic event sequences called prime event languages. These sequences are then examined with finite-order Markov models, mutual-information calculations, and train-test splits on primes up to 5 billion. First-order modeling produces a small but consistent drop in test-set cross entropy of roughly 0.0054 bits, and mutual information falls by more than four orders of magnitude after lag 1. The results indicate that the events carry limited short-range memory rather than being fully independent or strongly predictable. This matters because it supplies a new symbolic representation that can expose arithmetic structure through standard information-theoretic tools.
What carries the argument. The Twin Prime Event Language, a symbolic sequence built from twin-prime occurrences and prime-gap events for stochastic-process analysis.
Core claim. By representing twin-prime occurrences and gap events as a symbolic sequence called the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, an information gain of about 0.0054 bits that survives out-of-sample validation. Mutual information drops by more than four orders of magnitude from lag 1 to lag 2, showing that measurable dependence is concentrated at lag 1 with an effective information horizon of one event. The prime event languages therefore display weak short-range statistical structure rather than being memoryless or strongly predictable.
The premise it rests on. The chosen mapping from arithmetic prime gaps and twin occurrences to event symbols encodes real dependencies without introducing spurious correlations from the encoding itself.
If the paper is right (Pith's inferences, not the authors')
The next event carries a small amount of information about the previous one.
Models beyond first order add negligible predictive value.
Mutual-information analysis independently verifies the Markov-model results.
The detected structure is reproducible on held-out data rather than an artifact of fitting.
The same event-language construction could be applied to other fixed-gap constellations to test whether short-range dependence appears more generally.
If the weak dependence remains stable at much larger scales, it would place a quantitative limit on how much local predictability exists in prime distributions.
Information-theoretic summaries of this kind could serve as a diagnostic complement to classical analytic estimates of prime gaps.
Strongest defence (simulated, not the authors)
We thank the referee for the careful reading and the constructive major comment. We address it directly below and will revise the manuscript accordingly.
-
Referee: [Event-language construction (abstract and §2–3)] Event-language construction (abstract and §2–3): the manuscript supplies no explicit alphabet or deterministic mapping from primes to symbols (e.g., binary twin/non-twin flag, binned gap size, or joint encoding). Because the headline result is a lag-1 dependence four orders of magnitude smaller than the per-symbol entropy, even a modest definitional coupling (a twin event forcing the next gap symbol) would produce exactly the observed signature. Without the precise construction rule and a null-model argument that the encoding itself induces no lag-1 correlation, the out-of-sample cross-entropy drop cannot be interpreted as genuine arithmetic structure.
Simulated defence: We agree that an explicit description of the alphabet and mapping is required for unambiguous interpretation, especially given the small effect size. In the revised manuscript we will expand §2 to state the precise deterministic rules: the Twin-Prime Event Language uses the binary alphabet {T,N} with T marking the occurrence of a twin-prime pair (p, p+2 both prime) and N otherwise; the Record-Gap Event Language uses a ternary alphabet derived from whether each successive gap sets a new record. We will also add a short null-model subsection that applies the identical encoding to a Poisson-process surrogate with the same marginal gap distribution and verifies that the surrogate produces no measurable lag-1 mutual information (upper bound < 10^{-6} bits). These additions will allow readers to confirm that the reported 0.0054-bit gain is not an artifact of the encoding itself.
Check this review
Pith stored no record of this review's passes and took no fingerprint of it. Reviews made by code from 13 Nov 2026 on carry both.
How often reviews like this one are right
Reviews like this one: written by grok-4.3, where what was read was not recorded.
How often objections from reviews like this one are right: not yet measured
Reviews by people
This review was written by a machine. No person has reviewed this paper on Pith yet. A scientist listed on Pith can review it for a fee, and their review is published here whatever it concludes.
The paper
Abstract
Prime numbers are traditionally studied through numerical, probabilistic, and analytic frameworks. In this work, we introduce the concept of a prime event language, in which arithmetic phenomena are represented as symbolic event sequences and analyzed using tools from information theory and stochastic processes. Using all primes up to N = 5 × 109 (234,954,223 primes), we construct event languages based on twin-prime occurrences and record prime-gap events. We investigate their statistical properties through finite-order Markov models, train/test validation, mutual-information analysis, and information-horizon measurements. For the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, corresponding to an information gain of approximately 0.0054 bits. This gain survives out-of-sample validation and therefore reflects genuine statistical structure rather than overfitting. Mutual-information analysis independently confirms the Markov results and shows that measurable dependence is concentrated almost entirely at lag 1. The mutual information decreases from approximately 5.96 × 10−3 bits at lag 1 to approximately 5.07 × 10−7 bits at lag 2 (approximately 11,700-fold reduction), representing a reduction of more than four orders of magnitude. Beyond lag 2, residual information fluctuates near the statistical noise floor. These results indicate that prime event languages are neither perfectly memoryless nor strongly predictable. Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event. More broadly, this work illustrates how alternative representations can reveal information-theoretic organization that remains less apparent in conventional numerical descriptions of arithmetic phenomena.
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. No sentence in this record was written by a model.
abstract compiled · 2026-09-23
The authors' main claim, as the classifier picked it out 0.92
“Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event.”
How the main claim is stated: asserted 0.99
What the abstract itself states, as probabilities: claims first 0.08 · states limitation 0.65 · human participants 0.01 · controlled comparison 0.33 · randomized assignment 0.01 · states quantitative result 0.99 · compares with prior results 0.66 · mentions code or data availability 0.02
The abstract, sentence by sentence
This table labels the abstract only (arXiv listing abstract v1). The number is the probability the classifier gave the label.
| Sentence | Role | The authors' own work | States the main conclusion | Strength |
|---|---|---|---|---|
| Prime numbers are traditionally studied through numerical, probabilistic, and analytic frameworks. | background 1.00 | 0.03 | 0.01 | asserted 1.00 |
| In this work, we introduce the concept of a prime event language, in which arithmetic phenomena are represented as symbolic event sequences and analyzed using tools from information theory and stochastic processes. | contribution 0.99 | 0.84 | 0.05 | asserted 0.99 |
| Using all primes up to $N = 5 \times 10^9$ (234,954,223 primes), we construct event languages based on twin-prime occurrences and record prime-gap events. | method 0.96 | 0.95 | 0.02 | asserted 0.99 |
| We investigate their statistical properties through finite-order Markov models, train/test validation, mutual-information analysis, and information-horizon measurements. | method 0.98 | 0.96 | 0.03 | asserted 0.94 |
| For the Twin Prime Event Language, first-order Markov modeling reduces test-set cross entropy from 0.325350 bits to 0.319949 bits, corresponding to an information gain of approximately 0.0054 bits. | result 1.00 | 0.96 | 0.11 | asserted 1.00 |
| This gain survives out-of-sample validation and therefore reflects genuine statistical structure rather than overfitting. | interpretation 0.93 | 0.93 | 0.07 | asserted 1.00 |
| Mutual-information analysis independently confirms the Markov results and shows that measurable dependence is concentrated almost entirely at lag 1. | result 0.99 | 0.95 | 0.09 | asserted 1.00 |
| The mutual information decreases from approximately $5.96 \times 10^{-3}$ bits at lag 1 to approximately $5.07 \times 10^{-7}$ bits at lag 2 (approximately 11,700-fold reduction), representing a reduction of more than four orders of magnitude. | result 1.00 | 0.95 | 0.08 | asserted 1.00 |
| Beyond lag 2, residual information fluctuates near the statistical noise floor. | result 1.00 | 0.93 | 0.04 | asserted 0.99 |
| These results indicate that prime event languages are neither perfectly memoryless nor strongly predictable. | interpretation 0.98 | 0.90 | 0.26 | hedged possibility 0.60 |
| Instead, they exhibit weak but reproducible short-range statistical structure characterized by first-order dependence and an effective information horizon of approximately one event. | interpretation 0.99 | 0.94 | 0.79 | asserted 0.99 |
| More broadly, this work illustrates how alternative representations can reveal information-theoretic organization that remains less apparent in conventional numerical descriptions of arithmetic phenomena. | interpretation 0.99 | 0.61 | 0.19 | asserted 0.89 |
What kind of paper the classifier reports this is: empirical study 0.70 · evidence from simulation or computation 0.64
What was examined, and what was not
Sources read
- arXiv listing abstract v1
Not examined
- full text
- figures and tables
- references and citing sentences
- relations to other papers
Levels run
- P abstract
Not run
- S sections
- T body sentences
- C citations
- R cross-paper relations
How the labels were made
Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-09-23: 1 request, 8,990 input tokens.
Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. This record as JSON
Figures (7)
Figures are the authors', reproduced from the paper.
References (10)
- [1] Shannon, C. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27(3), 379–423; 27(4), 623–656 on Pith
- [2] Cover, T. M., & Thomas, J. A. (2006). Elements of Information Theory (2nd ed.). Wiley on Pith
- [3] Norris, J. R. (1998). Markov Chains. Cambridge University Press on Pith
- [4] Cramér, H. (1936). On the order of magnitude of the difference between consecutive prime numbers. Acta Arithmetica, 2, 23–46 on Pith
- [5] Hardy, G. H., & Littlewood, J. E. (1923). Some problems of 'Partitio Numerorum'; III: On the expression of a number as a sum of primes. Acta Mathematica, 44, 1–70 on Pith
- [6] Allouche, J.-P., & Shallit, J. (2003). Automatic Sequences: Theory, Applications, Generalizations. Cambridge University Press on Pith
- [7] Lind, D., & Marcus, B. (1995). An Introduction to Symbolic Dynamics and Coding. Cambridge University Press on Pith
- [8] Li, M., & Vitányi, P. (2008). An Introduction to Kolmogorov Complexity and Its Applications (3rd ed.). Springer on Pith
- [9] Granville, A. (1995). Harald Cramér and the distribution of prime numbers. Scandinavian Actuarial Journal, 1995(1), 12–28 on Pith
- [10] Tao, T. (2014). Bounded gaps between primes. Proceedings of the International Congress of Mathematicians (ICM 2014), Seoul, Korea, Vol. II, pp. 363–383 on Pith
Challenges and discussion
Disagree with the review, or know something it missed? Leave a comment, or challenge this review formally: a challenge becomes a permanent entry in this paper's record, and its decision is published here.
Come back by email
A short list of the week's newly reviewed papers. Nothing is sent until you confirm from your inbox, and every email has a link that stops it. No account.
No comments yet.
Sign in to comment