REVIEW 3 major objections 6 minor 1 cited by
Shannon information and integrated information: message and meaning
T0 review · 3 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read This paper argues that the meaning of an experience is the cause–effect structure a conscious system unfolds from its own activity, so meaning is communicated only when sender and receiver unfold similar structures.
desk verdict A clear IIT-based position paper on meaning and communication, undermined only by the undefined notion of structural similarity that carries the central claim. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the Φ-structure (cause–effect structure): the set of causal distinctions specified by subsets of units within a complex, together with the relations that bind them, determined from the system's transition probability matrix and its current state. It carries the argument by replacing the picture of meaning as a code with a picture of meaning as a structure: meaning is not read off a symbol but unfolded from a substrate, and communication of meaning becomes a matter of structural similarity between the Φ-folds of sender and receiver.
What would settle it
A direct test would compare two conscious subjects with deliberately different causal architectures: if they can be shown to share the same specific conscious content while their unfolded Φ-folds differ substantially under the IIT formalism, the identity between meaning and Φ-structure fails. Concretely, one could compute Φ-fold similarity for subjects with different connectomes and measure whether their success in communicating a specific percept tracks Φ-fold similarity better than it tracks Shannon mutual information of the transmitted symbols.
Extended reading notes
Core claim
The paper contrasts two axiomatic uses of probability: Shannon's extrinsic account of messages and IIT's intrinsic account of meaning. It claims that the Φ-structure unfolded from a complex—a maximally irreducible substrate—in its current state fully characterizes, with no additional ingredients, how an experience feels and what it intrinsically means. Within the Φ-structure, each content of experience is a Φ-fold, a sub-structure of distinctions and relations; the feeling of seeing the house on fire is that Φ-fold. Communication of meaning therefore requires that a source complex's Φ-fold trigger a similar Φ-fold in a target complex. Symbol transmission is neither sufficient (a perfect channel can fail to trigger the intended fold) nor necessary (without similar folds, no meaning is carried), and the amount of meaning communicated could in principle be measured by the similarity of source and target Φ-folds.
Load-bearing premise
The load-bearing premise is that Φ-structures from different substrates can be compared by a well-defined similarity measure; the paper itself notes that this is not easy, since it requires unfolding very large structures and finding optimal ways to compare them. Without such a measure, the claim that meaning is communicated when source and target Φ-folds are similar is not yet well-defined.
Editorial extensions
If this is right
- Standard digital computers, whose wiring cannot support high-Φ complexes, can transmit messages perfectly while communicating no intrinsic meaning; their utterances mean something only when a conscious being interprets them.
- Because the wiring of each brain differs through development and learning, shared meanings are never identical: communication of meaning is always approximate, and some meanings will be idiosyncratic.
- Shannon information and integrated information are complementary rather than competing: one quantifies symbol transmission, the other quantifies meaning, and a full account of communication needs both.
- The amount of meaning successfully communicated can in principle be measured by the similarity of the source and target Φ-folds, not by bit rate, channel capacity, or perceptual richness.
Reading between the lines
- If meaning is identical to Φ-structure, then the claim that digital computers have no intrinsic meaning is an empirical bet about their wiring, not a consequence of the identity itself; a silicon substrate that could support a high-Φ complex would, by the paper's own logic, have meaning.
- The framework suggests a testable research program: approximate Φ-fold similarity with computable measures and check whether subjective reports of 'getting it' track structural similarity better than mutual information of neural codes.
- It also implies a strong form of untranslatability: since meanings are absolute structures rather than positions in a semantic space, translation can only maximize overlap between Φ-folds, and some meanings may be untranslatable.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper contrasts Shannon information theory with integrated information theory (IIT), arguing that Shannon information concerns messages, codes, and extrinsic transmission, whereas IIT treats meaning as an intrinsically defined cause–effect structure (Φ-structure) unfolded from a conscious complex. The authors introduce the notion of a Φ-fold as a sub-structure corresponding to a content of experience, and claim that communication of meaning occurs when a source Φ-fold triggers a similar Φ-fold in a target complex. The paper reviews IIT's axioms and postulates, compares the two frameworks in a table, discusses implications for neuroscience and artificial systems, and includes two supplementary sections on information theory and IIT.
Significance. If the central claim held, the paper would provide a principled distinction between information as message transmission and meaning as consciousness-dependent structure, and would ground a research program for measuring meaning transfer. The paper is clearly written and gives a useful side-by-side comparison of Shannon information and IIT, and it is transparent about the major open problem, namely the absence of a concrete similarity measure for Φ-structures (footnote 14). However, the communication-of-meaning claim is not derived from IIT's axioms; it is an additional definitional step. The paper would be significant as a conceptual proposal, but as it stands the key notion of similarity remains unformalized, so the central conclusion is not yet a testable result. The paper also credits prior and forthcoming work appropriately, and it explicitly acknowledges the computational infeasibility of unfolding large Φ-structures, which is a fair limitation.
major comments (3)
- [Communicating integrated information as meaning (Fig. 6 and following text)] The paper's central claim, stated in the abstract and repeated in this section, is that 'for the communication of meaning, the cause–effect structures of sender and receiver must be similar.' However, no formal definition of 'similar' is provided. The text says 'the similarity of the two Φ-folds could be used to measure the amount of meaning communicated,' and footnote 14 concedes that developing ways to compare them optimally is 'not easy.' This is not a minor technicality: without a metric or an equivalence relation on Φ-structures, the claim cannot be evaluated as true or false, and the amount of meaning communicated is undefined. The paper should either supply a candidate similarity measure (or a set of necessary conditions) or explicitly present the communication claim as a conjecture rather than a consequence of IIT.
- [Communicating integrated information as meaning, footnote 15] Footnote 15 creates an internal tension with the main claim. It states that 'in IIT's analysis, the meaning of an experience is defined in absolute terms by the distinctions and relations that compose a specific Φ-structure, rather than by its similarity to other Φ-structures,' and it allows for a 'translation' mapping between radically different Φ-structures. If meaning is absolute, then similarity between Φ-structures is an extrinsic relation imposed by the analyst; it is not part of IIT's fundamental explanatory identity ('with no additional ingredients'). The 'it follows' in the abstract therefore does not follow from the axioms and postulates. The paper should clarify how the similarity relation is grounded in IIT or acknowledge that it is a new, extra-theoretical definition.
- [Integrated information theory and Information processing vs. information structures] The identification of meaning with the Φ-structure is asserted as IIT's fundamental explanatory identity, not independently demonstrated. The paper states that the Φ-structure 'fully characterizes, with no additional ingredients, how an experience feels—its quality—which defines its intrinsic meaning.' For a paper whose central contribution is a consequence of this identity, this is acceptable as a starting point, but the paper should more clearly separate (i) the IIT-internal definition of meaning from (ii) the new claim about communication of meaning. In particular, the transition from 'meaning is the Φ-structure' to 'communicating meaning requires similar Φ-structures' involves an additional premise about how meaning transfers between systems, which is not part of IIT's postulates. The paper should state this premise explicitly.
minor comments (6)
- [Supplementary material II] The notion of a 'Φ-fold' is used throughout the main text but only informally characterized in the supplementary material; a precise definition (e.g., a sub-structure formed by a subset of distinctions and relations) would improve clarity.
- [Table I] The capitalization in the final row is inconsistent: 'Meaning Must be provided extrinsically' should be 'Meaning must be provided extrinsically.'
- [References] The reference list includes several items marked 'forthcoming' (refs. 13, 14, 52) and an arXiv manuscript (ref. 11) without publication details; please provide updated versions or URLs where possible.
- [Supplementary material I] The displayed equation for Shannon entropy appears to be missing the summation sign in the provided text; please ensure all equations are typeset correctly.
- [Figure 6] Panel (c) of Figure 6 refers to 'perceptual richness' without defining the term in the caption; a brief definition or a pointer to Supplementary material II would help.
- [Information processing vs. information structures] The statement 'information processing can only ever decrease the information transmitted over a channel' is too broad as written; the data-processing inequality applies to specific Markov chains and should be qualified accordingly.
Circularity Check
Central claim reduces to IIT's definitional identity: meaning is the Φ-structure, and 'communication of meaning' is stipulated as triggering a similar Φ-fold; the load-bearing identity is self-cited.
-
self definitional
[Abstract; Section 'Communicating integrated information as meaning' (Fig. 6 discussion)]
"IIT considers meaning as integrated information and characterizes it as a structure, rather than as a message or code... It follows that, for the communication of meaning, the cause–effect structures of sender and receiver must be similar. ... In short, meaning can only be communicated if a Φ-fold within a Φ-structure specified by a source complex triggers a similar Φ-fold within a Φ-structure specified by a target complex."
The conclusion is obtained by combining two stipulations: (i) intrinsic meaning is the Φ-structure, and (ii) communication of meaning occurs when a source Φ-fold triggers a similar Φ-fold in the target. The first is IIT's definitional identity; the second is introduced as the 'direct implication' without independent argument. No operational criterion for 'similar' is supplied—footnote 14 concedes that comparing Φ-folds optimally is unsolved. Hence the abstract's 'It follows' is not a derivation from IIT's axioms; it is a restatement of the definition of meaning-communication, with the necessity of structural similarity built into the chosen definition rather than established.
-
self citation load bearing
[Section 'Integrated information theory' (p. 5); Supplementary II (p. 21)]
"The cause–effect structure (or Φ-structure) unfolded from a complex in its current state fully characterize[s], with no additional ingredients, how an experience feels—its quality—which defines its intrinsic meaning. ... IIT claims that every property of an experience must be accounted for by the Φ-structure specified by its substrate, with no additional ingredients. This is the fundamental explanatory identity of IIT[5]."
The paper's central derivation assumes the fundamental explanatory identity of IIT—that a Φ-structure fully defines intrinsic meaning—and cites IIT 4.0 [5], a paper by the same research group including the present authors. That identity is exactly the premise that makes the communication conclusion follow. The paper supplies no independent proof, external benchmark, or falsifiable test for it here; it is taken as a postulate of the theory. Thus the chain 'Φ-structure = meaning ⇒ communication requires similar Φ-structures' rests on a load-bearing self-citation that already contains the definitional equation.
full rationale
This is a theory-exposition paper that explicitly builds on IIT rather than testing it; its contrast between Shannon information and IIT is self-consistent and not circular. However, the paper's central claim is presented as a derivation: 'It follows that, for the communication of meaning, the cause–effect structures of sender and receiver must be similar.' The derivation rests on two moves. First, the premise 'meaning = Φ-structure' is imported as IIT's fundamental explanatory identity from a self-authored citation (IIT 4.0), with no independent support in the paper. Second, 'communication of meaning' is stipulated as the source Φ-fold triggering a similar Φ-fold in the target; the same section then says similarity could measure the amount communicated. No formal similarity measure is defined—footnote 14 concedes this is unsolved—so the necessity of similarity is a definitional choice, not a theorem. The paper is transparent about being an IIT-based account, which mitigates the appearance of deception, but the central claim does reduce by construction to the definitional identity plus an added, unformalized similarity criterion. Hence score 7.
Assumptions & free parameters
assumptions (5)
- domain assumption Experience exists (0th axiom).
- domain assumption The five axioms of phenomenal existence (intrinsicality, information, integration, exclusion, composition) are irrefutably true of every experience.
- domain assumption Physical existence is cause-effect power, assessed through interventional probabilities.
- domain assumption A complex is the set of units that is maximally irreducible, identified by the principle of maximal existence.
- domain assumption The cause-effect structure (Φ-structure) of a complex in a state fully characterizes experience with no additional ingredients (IIT's explanatory identity).
invented entities (3)
-
Φ-structure (cause-effect structure)
-
Φ-fold
-
Complex (maximally irreducible substrate)
Cite this review
Pith. "Pith review of Shannon information and integrated information: message and meaning." pith.science (2026). https://pith.science/paper/3MPINSUB
@misc{pith2026241210626,
author = {Pith},
title = {Pith review of: Shannon information and integrated information: message and meaning},
year = {2026},
howpublished = {\url{https://pith.science/paper/3MPINSUB}},
note = {Machine review of arXiv:2412.10626}
}
read the original abstract
Information theory, introduced by Shannon, has been extremely successful and influential as a mathematical theory of communication. Shannon's notion of information does not consider the meaning of the messages being communicated but only their probability. Even so, computational approaches regularly appeal to "information processing" to study how meaning is encoded and decoded in natural and artificial systems. Here, we contrast Shannon information theory with integrated information theory (IIT), which was developed to account for the presence and properties of consciousness. IIT considers meaning as integrated information and characterizes it as a structure, rather than as a message or code. In principle, IIT's axioms and postulates allow one to "unfold" a cause-effect structure from a substrate in a state, a structure that fully defines the intrinsic meaning of an experience and its contents. It follows that, for the communication of meaning, the cause-effect structures of sender and receiver must be similar.
Figures
Figures from the paper (4 more)
Forward citations
Cited by 1 Pith paper
-
Intrinsic meaning, perception, and matching
Within IIT, perception is formalized as a stimulus-triggered portion of a Φ-structure, and perceptual differentiation and matching quantify how much intrinsic meaning an environment triggers.
Reference graph
Works this paper leans on
-
[1]
Floridi, L., The Philosophy of Information. 2011
work page 2011
- [2]
-
[3]
Minnesota Studies in the Philosophy of Science, 1975
Putnam, H., The meaning of 'meaning'. Minnesota Studies in the Philosophy of Science, 1975. 7: p. 131-193
work page 1975
-
[4]
Bell System Technical Journal, 1948
Shannon, C.E., A Mathematical Theory of Communication. Bell System Technical Journal, 1948. 27(3): p. 379-423
work page 1948
-
[5]
Albantakis, L., et al., Integrated information theory (IIT) 4.0: Formulating the properties of phenomenal existence in physical terms. PLoS Comput Biol, 2023. 19(10): p. e1011465
work page 2023
-
[6]
MacKay, D.J.C., Information Theory, Inference, and Learning Algorithms, D.J.C. MacKay, Editor. 2003, Cambridge University Press. p. 334�C340
work page 2003
-
[7]
Rieke, F., et al., Spikes: exploring the neural code. 1999
work page 1999
-
[8]
Cover, T.M., Elements of information theory. 1999: John Wiley & Sons
work page 1999
Show all 58 references
-
[9]
83(4): p
Nagel, T., What is it like to be a bat? The Philosophical Review, 1974. 83(4): p. 435-450
1974
-
[10]
Neuroscience of Consciousness, 2021
Ellia, F., et al., Consciousness and the fallacy of misplaced objectivity. Neuroscience of Consciousness, 2021. 2021(2)
2021
-
[11]
Juel, and G
Mayner, W.G.P., B.E. Juel, and G. Tononi, Intrinsic meaning, perception, and matching. arXiv, 2024
2024
-
[12]
Nat Rev Neurosci, 2016
Tononi, G., et al., Integrated information theory: from consciousness to its physical substrate. Nat Rev Neurosci, 2016. 17(7): p. 450-61
2016
-
[13]
forthcoming
Grasso, M.a.T., G, How do phenomenal objects bind general concepts with particular features. forthcoming
-
[14]
Grasso, and G
Comolatti, R., M. Grasso, and G. Tononi, Why does time feel the way it does? arXiv, 2024
2024
-
[15]
Haun, A. and G. Tononi, Why Does Space Feel the Way it Does? Towards a Principled Account of Spatial Experience. Entropy, 2019. 21(12): p. 1160
2019
-
[16]
PLOS ONE, 2023
Melloni, L., et al., An adversarial collaboration protocol for testing contrasting predictions of global neuronal workspace and integrated information theory. PLOS ONE, 2023. 18(2): p. e0268577
2023
-
[17]
Science, 2005
Massimini, M., et al., Breakdown of cortical effective connectivity during sleep. Science, 2005. 309(5744): p. 2228-32
2005
-
[18]
Ann Neurol, 2016
Casarotto, S., et al., Stratification of unresponsive patients by an independently validated index of brain complexity. Ann Neurol, 2016. 80(5): p. 718-729
2016
-
[19]
Towards Conscious AI Systems Symposium - Proceedings of the AAAI 2019, 2019
Findlay, G., et al., Dissociating Intelligence from Consciousness in Artificial Systems – Implications of Integrated Information Theory. Towards Conscious AI Systems Symposium - Proceedings of the AAAI 2019, 2019
2019
-
[20]
arXiv preprint arXiv:2412.04571, 2024
Findlay, G., et al., Dissociating Artificial Intelligence from Artificial Consciousness. arXiv preprint arXiv:2412.04571, 2024. 25
2024 arXiv
-
[21]
2024; Available from: https://www.iit.wiki
Integrated Information Theory Wiki. 2024; Available from: https://www.iit.wiki
2024
-
[22]
and P.M.B
Li, M. and P.M.B. Vitanyi, An introduction to Kolmogorov complexity and its applications. 1997
1997
-
[23]
Williams, P.L. and R.D. Beer, Nonnegative Decomposition of Multivariate Information. CoRR, 2010. abs/1004.2515
2010 arXiv
-
[24]
Advances in Neural Information Processing Systems, 1989
Steveninck, v., et al., Reading a Neural Code. Advances in Neural Information Processing Systems, 1989. 2
1989
-
[25]
The Behavioral and brain sciences, 2013
Clark, A., Whatever next? Predictive brains, situated agents, and the future of cognitive science. The Behavioral and brain sciences, 2013. 36(3): p. 181-204
2013
-
[26]
Friston, K., The free-energy principle: a unified brain theory? Nat Rev Neurosci,
-
[27]
Rao, R.P. and D.H. Ballard, Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience,
-
[28]
Dehaene, S. and J. -P. Changeux, Experimental and theoretical approaches to conscious processing. Neuron, 2011. 70(2): p. 200-227
2011
-
[29]
Blum, L. and M. Blum, A theory of consciousness from a theoretical computer science perspective: Insights from the Conscious Turing Machine. Proc Natl Acad Sci U S A, 2022. 119(21): p. e2115934119
2022
-
[30]
Sporns, and G.M
Tononi, G., O. Sporns, and G.M. Edelman, Measures of degeneracy and redundancy in biological networks. Proc Natl Acad Sci U S A, 1999. 96: p. 3257- 3262
1999
-
[31]
Neuron, 2022
Tseng, S.Y., et al., Shared and specialized coding across posterior cortical areas for dynamic navigation decisions. Neuron, 2022. 110(15): p. 2484-2502.e16
2022
-
[32]
Buzsáki, G., Neural syntax: cell assemblies, synapsembles, and readers. Neuron,
-
[33]
Brette, R., Is coding a relevant metaphor for the brain? bioRxiv, 2018: p. 168237
2018
-
[34]
Sporns, and G.M
Tononi, G., O. Sporns, and G.M. Edelman, A complexity measure for selective matching of signals by the brain. Proc Natl Acad Sci U S A, 1996. 93(8): p. 3422- 7
1996
-
[35]
1988, Cambridge, Mass.: MIT Press
Putnam, H., Representation and reality. 1988, Cambridge, Mass.: MIT Press. xv, 136 p
1988
-
[36]
Erkenntnis, 2013
Blackmon, J., Searle’s Wall. Erkenntnis, 2013. 78(1): p. 109-117
2013
-
[37]
The Behavioral and brain sciences, 1998
Edelman, S., Representation is representation of similarities. The Behavioral and brain sciences, 1998. 21(4): p. 449-498
1998
-
[38]
O'Brien, G. and J. Opie, Chapter 1 - Notes Toward a Structuralist Theory of Mental Representation, in Representation in Mind , H. Clapin, P. Staines, and P. Slezak, Editors. 2004, Elsevier: Oxford. p. 1-20
2004
-
[39]
Sensory Qualities, 1996
Clark, A., Sensory Qualities. Sensory Qualities, 1996
1996
-
[40]
Gardenfors, P., Semantics Based on Conceptual Spaces. 2011
2011
-
[41]
2008, Toronto ; Buffalo: University of Toronto Press
Brier, S., Cybersemiotics : why information is not enough! Toronto studies in 26 semiotics and communication. 2008, Toronto ; Buffalo: University of Toronto Press. xx, 477 p
2008
-
[42]
Nakai, T. and S. Nishimoto, Representations and decodability of diverse cognitive functions are preserved across the human cortex, cerebellum, and subcortex. Commun Biol, 2022. 5(1): p. 1245
2022
-
[43]
Lemon, R.N. and S.A. Edgley, Life without a cerebellum. Brain, 2010. 133(Pt 3): p. 652-654
2010
-
[44]
Behavioral and Brain Sciences, 1980
Searle, J.R., Minds, brains, and programs. Behavioral and Brain Sciences, 1980. 3(03): p. 417-424
1980
-
[45]
BMC Neurosci,
Tononi, G., An information integration theory of consciousness. BMC Neurosci,
-
[46]
Biol Bull, 2008
Tononi, G., Consciousness as integrated information: a provisional manifesto. Biol Bull, 2008. 215: p. 216-242
2008
-
[47]
Albantakis, and G
Oizumi, M., L. Albantakis, and G. Tononi, From the phenomenology to the mechanisms of consciousness: integrated information theory 3.0. PLoS Comput Biol, 2014. 10(5): p. e1003588
2014
-
[48]
Neuroimage, 2015
Pigorini, A., et al., Bistability breaks-off deterministic responses to intracortical stimulation during non-REM sleep. Neuroimage, 2015. 112: p. 105-13
2015
-
[49]
Neurosci Conscious, 2021
Sarasso, S., et al., Consciousness and complexity: a consilience of evidence. Neurosci Conscious, 2021. 2021(2): p. niab023
2021
-
[50]
Verdú, S. and T.S. Han, The role of the asymptotic equipartition property in noiseless source coding. IEEE Transactions on Information Theory, 1997. 43(3): p. 847-857
1997
-
[51]
Pereira, and W
Tishby, N., F.C. Pereira, and W. Bialek, The information bottleneck method. arXiv preprint physics/0004057, 2000
2000 arXiv
-
[52]
forthcoming
Tononi, G., On Being: Ontological and metaphysical implictions of Integrated Information Theory (IIT). forthcoming
-
[53]
Entropy (Basel), 2023
Marshall, W., et al., System Integrated Information. Entropy (Basel), 2023. 25(2): p. 334
2023
-
[54]
Scientific Reports, 2020
Barbosa, L.S., et al., A measure for intrinsic information. Scientific Reports, 2020. 10(1): p. 18803
2020
-
[55]
bioRxiv, 2024: p
Marshall, W., et al., Intrinsic Units: Identifying a system’s causal grain. bioRxiv, 2024: p. 2024.04.12.589163
2024
-
[56]
Zaeemzadeh, A. and G. Tononi, Upper bounds for integrated information. PLoS Comput Biol, 2024. 20(8): p. e1012323
2024
-
[57]
Tononi, G. and C. Cirelli, Sleep and the price of plasticity: from synaptic and cellular homeostasis to memory consolidation and integration. Neuron, 2014. 81(1): p. 12-34
2014
-
[58]
Boly, and C
Tononi, G., M. Boly, and C. Cirelli, Consciousness and sleep. Neuron, 2024
2024
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.