Symphony of high-dimensional brain
Pith reviewed 2026-05-25 13:36 UTC · model grok-4.3
The pith
A journal discussion synthesizes expert views on revising machine learning theory for non-random high-dimensional distributions in the brain.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By reviewing the collected opinions, the paper shows that the simplicity revolution calls for revisions to common machine learning theory to accommodate the difference between theoretical random distributions and the extremely non-random distributions found in real brain data, while also requiring attention to multiple forms of the curse of dimensionality and high-dimensional pitfalls in neuroscience.
What carries the argument
The symphony of opinions from the discussion participants, which aggregates their responses to map areas of agreement and divergence on the simplicity revolution.
Load-bearing premise
The discussion participants' views are taken as representative enough to draw conclusions about field-wide implications for the simplicity revolution.
What would settle it
A broader survey of machine learning and neuroscience researchers that finds substantially different priorities or concerns would show that the analyzed opinions do not represent the fields.
read the original abstract
This paper is the final part of the scientific discussion organised by the Journal "Physics of Life Rviews" about the simplicity revolution in neuroscience and AI. This discussion was initiated by the review paper "The unreasonable effectiveness of small neural ensembles in high-dimensional brain". Phys Life Rev 2019, doi 10.1016/j.plrev.2018.09.005, arXiv:1809.07656. The topics of the discussion varied from the necessity to take into account the difference between the theoretical random distributions and "extremely non-random" real distributions and revise the common machine learning theory, to different forms of the curse of dimensionality and high-dimensional pitfalls in neuroscience. V. K{\r{u}}rkov{\'a}, A. Tozzi and J.F. Peters, R. Quian Quiroga, P. Varona, R. Barrio, G. Kreiman, L. Fortuna, C. van Leeuwen, R. Quian Quiroga, and V. Kreinovich, A.N. Gorban, V.A. Makarov, and I.Y. Tyukin participated in the discussion. In this paper we analyse the symphony of opinions and the possible outcomes of the simplicity revolution for machine learning and neuroscience.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper is the concluding contribution to a discussion organized by Physics of Life Reviews on the simplicity revolution in neuroscience and AI, initiated by the 2019 review 'The unreasonable effectiveness of small neural ensembles in high-dimensional brain'. It summarizes and analyzes the opinions expressed by the listed participants (V. Kůrková, A. Tozzi and J.F. Peters, R. Quian Quiroga, P. Varona, R. Barrio, G. Kreiman, L. Fortuna, C. van Leeuwen, V. Kreinovich, A.N. Gorban, V.A. Makarov, and I.Y. Tyukin) on topics including differences between theoretical random distributions and real non-random distributions, revisions to machine-learning theory, forms of the curse of dimensionality, and high-dimensional pitfalls in neuroscience, while discussing possible outcomes of the simplicity revolution.
Significance. As a synthesis of a curated expert exchange rather than an original empirical or theoretical contribution, the manuscript provides a consolidated record of viewpoints on high-dimensional challenges in brain modeling and AI. Its value lies in documenting the range of positions within one organized discussion, which may assist readers in navigating the ongoing debate without advancing new claims or generalizations.
minor comments (2)
- The abstract and introduction list participants and topics but would benefit from explicit cross-references (e.g., section numbers) to the original discussion contributions to improve traceability for readers.
- A concise table or bullet-point summary of the principal positions held by each participant would enhance readability and allow quicker comparison of the 'symphony of opinions'.
Simulated Author's Rebuttal
We thank the referee for their positive assessment of the manuscript and the recommendation to accept. The paper is intended as a synthesis documenting the range of expert viewpoints from the Physics of Life Reviews discussion, which we believe provides value in consolidating the debate on the simplicity revolution without claiming new empirical or theoretical advances.
Circularity Check
No circularity; purely descriptive synthesis of external discussion
full rationale
The paper is the concluding commentary on a journal-organized discussion. Its content consists of reporting and analyzing opinions expressed by listed participants (V. Kůrková, A. Tozzi, etc.) on topics initiated by a prior review. No derivations, equations, predictions, fitted parameters, or first-principles claims appear. The text does not invoke uniqueness theorems, self-citations as load-bearing premises, or rename empirical patterns; it remains a straightforward synthesis without any reduction of outputs to its own inputs by construction.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
The unreasonable effectiveness of small neu ral ensembles in high- dimensional brain
K˚ urkov´ a V . Some insights from high-dimensional spheres: Comment on “The unreasonable effectiveness of small neu ral ensembles in high- dimensional brain” by Alexander N. Gorban et al. Phys Life Re v 2019; this issue. https://doi.org/10.1016/j.plrev.2019.03.014
-
[2]
Tozzi A, Peters JF. The Borsuk-Ulam theorem solves the cu rse of dimensionality: Comment on ”The unreasonable effect ive- ness of small neural ensembles in high-dimensional brain” b y Alexander N. Gorban et al. Phys Life Rev 2019; this issue. https://doi.org/10.1016/j.plrev.2019.04.008
-
[3]
The unreasonable ef- fectiveness of small neural ensembles in high-dimensional brain
V arona P . High and Low dimensionality in Neuroscience an d Artificial Intelligence: Comment on “The unreasonable ef- fectiveness of small neural ensembles in high-dimensional brain” by A.N. Gorban et al. Phys Life Rev 2019; this issue. https://doi.org/10.1016/j.plrev.2019.02.008
-
[4]
Barrio R. “Brainland” vs. “flatland”: how many dimension s do we need in brain dynamics? Comment on the paper “The unrea son- able effectiveness of small neural ensembles in high-dimen sional brain” by Alexander N. Gorban et al. Phys Life Rev 2019 ; this issue. https://doi.org/10.1016/j.plrev.2019.02.010
-
[5]
The unreasonable effectiveness of small neural ense mbles in high- dimensional brain
Kreiman G. It’s a small dimensional world after all: Comm ent on “The unreasonable effectiveness of small neural ense mbles in high- dimensional brain” by Alexander N. Gorban et al. Phys Life Re v 2019; this issue. https://doi.org/10.1016/j.plrev.2019.03.015
-
[6]
The unreasonable effectiveness of small neural ensembles in high-dimension al brain
Fortuna L. Nonlinear effects for the reinforcement of sm all neural ensembles in high dimensional brain: Comment on “ The unreasonable effectiveness of small neural ensembles in high-dimension al brain” by A.N. Gorban, V .A. Makarov, I.Y . Tyukin. Phys Lif e Rev 2019; this issue. https://doi.org/10.1016/j.plrev.2019.03.004
-
[7]
The unreasonable effectiveness of small neural ensembles in high-dimensional brain
V an Leeuwen C. The reasonable ineffectiveness of biolog ical brains in applying the principles of high-dimensional cybernetics: Comment on “The unreasonable effectiveness of small neural ensembles in high-dimensional brain” by Alexander N. Gorban et al. Phy s Life Rev 2019; this issue. https://doi.org/10.1016/j.plrev.2019.03.005
-
[8]
Quian Quiroga R. Akakhievitch revisited: Comment on ”Th e unreasonable effectiveness of small neural ensembles in h igh-dimensional brain” by Alexander N. Gorban et al. Phys Life Rev 2019; this i ssue. https://doi.org/10.1016/j.plrev.2019.02
-
[9]
Kreinovich V . The heresy of unheard-of simplicity: Comm ent on ”The unreasonable effectiveness of small neural en- sembles in high-dimensional brain” by A.N. Gorban, V .A. Mak arov, and I.Y . Tyukin. Phys Life Rev 2019; this issue. https://doi.org/10.1016/j.plrev.2019.04.006
-
[10]
L´ evy P .Probl` emes concrets d’analyse fonctionnelle. Paris: Gauthier-Villars, 1951
work page 1951
-
[11]
An Elementary Introduction to Modern Convex Geometry
Ball K. An Elementary Introduction to Modern Convex Geometry. Flavors of Geometry, V ol. 31. Cambridge, UK: MSRI Publications; 1997. https://doi.org/10.1007/BF02699376
-
[12]
Concentration of measure and isoperimetr ic inequalities in product spaces
Talagrand M. Concentration of measure and isoperimetr ic inequalities in product spaces. Publications Mathematiques de l’IHES 1995;81:73– 205
work page 1995
-
[13]
Probabilistic Bounds for Binary Classification of Large Data Sets
K˚ urkov´ a V , Sanguineti M. Probabilistic Bounds for Binary Classification of Large Data Sets. In: Oneto L, Navarin N , Sperduti A, Anguita D. (eds) Recent Advances in Big Data and Deep Learning. INNSBDD L 2019. Proceedings of the International Neural Networks So ciety, vol 1. Springer, pp. 309–319. https://doi.org/10.1007/978-3-030-16841-4_32
-
[14]
Stochastic separation theorems
Gorban AN, Tyukin IY . Stochastic separation theorems. Neural Netw. 2017;94:255–259. https://doi.org/10.1016/j.neunet.2017.07.014
-
[15]
Augmented Artificial Intelligence: a Conceptual Framework
Gorban AN, Grechuk B, Tyukin IY . Augmented Artificial In telligence: a Conceptual Framework, arXiv preprint 2018, a rXiv:1802.02172 [cs.AI]. https://arxiv.org/abs/1802.02172
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[16]
C orrection of AI systems by linear discriminants: Probabili stic foundations
Gorban AN, Golubkov A, Grechuk B, Mirkes EM, Tyukin IY . C orrection of AI systems by linear discriminants: Probabili stic foundations. Inf. Sci. 2018; 466:303-22. https://doi.org/10.1016/j.ins.2018.07.040
-
[17]
The unreasonable effe ctiveness of small neural ensembles in high-dimensional br ain
Gorban AN, Makarov V A, Tyukin IY . The unreasonable effe ctiveness of small neural ensembles in high-dimensional br ain. Phys Life Rev 2019; this issue. https://doi.org/10.1016/j.plrev.2018.09.005
-
[18]
Donoho D, Tanner J. Observed universality of phase tran sitions in high-dimensional geometry, with implications f or modern data analysis and signal processing. Phil. Trans. R. Soc. A 2009;367:4273 –4293. https://doi.org/10.1098/rsta.2009.0152
-
[19]
Principal manifolds and graphs i n practice: from molecular biology to dynamical systems
Gorban AN, Zinovyev A. Principal manifolds and graphs i n practice: from molecular biology to dynamical systems. In ternational Journal of Neural Systems 2010;20(03):219–232. https://doi.org/10.1142/S0129065710002383
-
[20]
(eds.) Principal Manifolds for Data Visualisation and Dimension R eduction
Gorban AN, K´ egl B, Wunsch D, Zinovyev A. (eds.) Principal Manifolds for Data Visualisation and Dimension R eduction. Lecture Notes in Computational Science and Engineering, V ol. 58. Berlin – Heidelberg – New Y ork: Springer, 2008. 4
work page 2008
-
[21]
Data complexity measured by princ ipal graphs
Zinovyev A, Mirkes E. Data complexity measured by princ ipal graphs. Comput. Mat. Appl. 2013;65(10):1471–1482. https://doi.org/10.1016/j.camwa.2012.12.009
-
[22]
Gorban AN, Tyukin IY , Blessing of dimensionality: math ematical foundations of the statistical physics of data, Ph il. Trans. R. Soc. A 2018;376:20170237. https://doi.org/10.1098/rsta.2017.0237
-
[23]
Single-cell trajectori es reconstruction, exploration and mapping of omics data wi th STREAM
Chen H, Albergante L, Hsu JY , Lareau CA, Bosco GL, Guan J, Zhou S, Gorban AN, Bauer DE, Aryee MJ, Langenau DM, Zinovyev A , Buenrostro JD, Y uan G-C, Pinello L. Single-cell trajectori es reconstruction, exploration and mapping of omics data wi th STREAM. Nature Communications 2019;10:1903. https://doi.org/10.1038/s41467-019-09670-4
-
[24]
Generalization of a theorem of Lusternik-Schni relman on covering of spheres
Fet AI. Generalization of a theorem of Lusternik-Schni relman on covering of spheres. Dokl. Akad. Nauk SSSR 1954;95 :1149-1152
work page 1954
-
[25]
Tozzi A. The multidimensional brain. Phys Life Rev 2019 . https://doi.org/10.1016/j.plrev.2018.12.004
-
[26]
Estimating the effective dimension of large biological datasets using Fisher separability analysis
Albergante L, Bac J, Zinovyev A. Estimating the effecti ve dimension of large biological datasets using Fisher sepa rability analysis, 2019, arXiv:1901.06328 [cs.LG]. https://arxiv.org/pdf/1901.06328.pdf
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[27]
Laboratory of advanced methods for high-dimensional d ata analysis https://github.com/lamhda
-
[28]
Discrete Sequential Informat ion Coding: Heteroclinic Cognitive Dynamics
Rabinovich MI, V arona P . Discrete Sequential Informat ion Coding: Heteroclinic Cognitive Dynamics. Front Comput Neurosci 2018;12:73. https://doi.org/10.3389/fncom.2018.00073
-
[29]
Johnson W, Lindenstrauss J. Extensions of Lipschitz ma ps into a Hilbert space.Conference in modern analysis and pr obability (New Haven, Conn., 1982), Contemp. Math., 1984;26:189–206. https://doi.org/10.1090/conm/026/737400
-
[30]
Approxima tion with random bases: Pro et contra
Gorban AN, Tyukin I, Prokhorov D, Sofeikov K. Approxima tion with random bases: Pro et contra. Inf. Sci. 2016:364–36 5;129–145. https://doi.org/10.1016/j.ins.2015.09.021
-
[31]
Approximate nearest neighbors: tow ards removing the curse of dimensionality
Indyk P , Motwani R. Approximate nearest neighbors: tow ards removing the curse of dimensionality. In STOC’98 Proce edings of the thirtieth annual ACM symposium on Theory of computing, Dallas, Texas, USA – May 24-26, 1998, ACM New Y ork, NY , 1998, pp. 604-613. https://doi.org/10.1145/276698.276876
-
[32]
bioRxiv 2017, doi:10.1101/214262
Gao P , Trautmann E, Y u B, Santhanam G, Ryu S, Shenoy K, Ganguli S. A theory of multineuronal dimensionality, dynamicsand measurement, bioRxiv 2017;214262. https://doi.org/10.1101/214262
-
[33]
Tyukin IY , Gorban AN, Calvo C, Makarova J, Makarov V A. High-dimensional brain. A tool for encoding and rapid learnin g of memories by single neurons, Bull. Math. Biol. 2018 https://doi.org/10.1007/s11538-018-0415-5
-
[34]
Large-scale model of mammal ian thalamocortical systems
Izhikevich EM, Edelman GM. Large-scale model of mammal ian thalamocortical systems. Proc. Natl. Acad. Sci. U.S.A. 2008 105(9):3593-8. https://doi.org/10.1073/pnas.0712231105
-
[35]
Roberts A, Conte D, Hull M, Merrison-Hort R, al Azad AK, B uhl E, Borisyuk R, Soffe SR. J. Neurosci. 2014 34(2):608-21. https://doi.org/10.1523/JNEUROSCI.3248-13.2014 5
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.