Formation of Artificial Neural Assemblies by Biologically Plausible Inhibition Mechanisms
Pith reviewed 2026-05-15 11:26 UTC · model grok-4.3
The pith
A gamma-cycle-inspired inhibition rule lets network dynamics set the size of formed neural assemblies and raises their recovery rate.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By implementing an E%-winners-take-all selection process inspired by gamma oscillation cycles together with an inhibition mechanism based on the excitatory to inhibitory neuron ratio, the model permits the network's own dynamics to determine the size of the formed assemblies, yielding higher recovery rates for these assemblies upon evocation of the generating stimuli than the original Assembly Calculus model.
What carries the argument
E%-winners-take-all selection combined with E/I-ratio inhibition, which selects active neurons according to statistical distributions consistent with power-law scaling rather than a fixed number.
If this is right
- Assembly size is no longer fixed by a preset parameter k but emerges from the network's activity statistics.
- Recovery of an assembly upon re-presentation of its generating stimulus exceeds the rate obtained with fixed k-winners-take-all selection.
- The model incorporates observed features of gamma cycles and cortical E/I ratios, bringing its dynamics closer to biological networks.
- Formed assemblies can represent external stimuli with greater flexibility because their membership is not dictated in advance.
Where Pith is reading between the lines
- Dynamic sizing may allow assemblies to adjust automatically to inputs of varying complexity without manual retuning of k.
- The approach could be tested by measuring whether assembly sizes in larger or more layered networks continue to follow the same emergent statistics.
- Incorporating more detailed oscillatory timing or synaptic plasticity rules might further increase the biological realism of the recovery advantage.
Load-bearing premise
That the E%-winners-take-all rule and E/I-ratio inhibition accurately capture the statistical structure of gamma cycles and cortical neuron ratios, and that the simulation outcomes will generalize beyond the tested network sizes and parameters.
What would settle it
Direct comparison of emergent assembly sizes and stimulus-evoked recovery rates in the simulated model against empirical measurements from cortical recordings that show different size distributions or lower recovery success.
Figures
read the original abstract
As proposed by Hebb's theory, neural assemblies are groups of excitatory neurons that fire synchronously and exhibit high synaptic density, representing external stimuli and supporting cognitive functions such as language and decision-making. Recently, a model called Assembly Calculus (AC) was proposed, enabling the formation of artificial neural assemblies through the $k$-winners-take-all selection process and Hebbian learning. Although the model is capable of forming assemblies according to Hebb's theory, the adopted selection process does not incorporate essential aspects of biological neural computation, as neural activity, which is often governed by statistical distributions consistent with power-law scaling. Given this limitation, the present work aimed to bring the model's dynamics closer to that observed in real cortical networks. To achieve this, a new selection mechanism inspired by the dynamics of gamma oscillation cycles, called E%-winners-take-all, was implemented, combined with an inhibition process based on the ratio between excitatory and inhibitory neurons observed in various regions of the cerebral cortex. The results obtained from our model (called E%-WTA model) were compared with those of the original model, and the analyses demonstrated that the introduced modifications allowed the network's own dynamics to determine the size of the formed assemblies. Furthermore, the recovery rate of these groups, through the evocation of the stimuli that generated them, became superior to that obtained in the original model.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes the E%-WTA model as an extension of Assembly Calculus, replacing k-winners-take-all with an E%-winners-take-all rule inspired by gamma-oscillation statistics and adding global inhibition scaled by the observed cortical E/I neuron ratio. It claims that these biologically motivated changes allow assembly sizes to emerge from recurrent network dynamics rather than from a fixed parameter, and that the resulting assemblies exhibit higher stimulus-evoked recovery rates than those formed by the original AC model.
Significance. If the central claims are substantiated with quantitative evidence, the work would strengthen the biological plausibility of computational models of Hebbian assembly formation by aligning selection and inhibition mechanisms more closely with cortical gamma cycles and E/I balance. This could improve the fidelity of large-scale simulations of memory and decision-making circuits, provided the size-emergence result generalizes beyond the tested regimes.
major comments (2)
- [Abstract and Results] Abstract and Results sections: the claims of 'superior' recovery rates and 'network's own dynamics determine the size' are asserted without any reported quantitative metrics, error bars, statistical tests, network size N, stimulus encoding details, or exact E% value. No tables or figures compare recovery percentages or assembly-size distributions between E%-WTA and the original k-WTA model, rendering the improvement unverifiable.
- [Methods] Methods and Model Definition: E% is introduced as a fixed hyper-parameter (analogous to k). The claim that assembly size emerges independently of modeler choice therefore requires explicit evidence that size is insensitive to modest variations in E% once E/I balance is held constant, or that size scales with N according to gamma-cycle statistics rather than E. No such sensitivity analysis or scaling plot is provided.
minor comments (2)
- [Methods] Clarify in the Methods section how the E%-WTA threshold is computed on each cycle and how it interacts with the E/I-ratio inhibition term; the current description leaves the precise update rule ambiguous.
- [Methods] Add a brief description of network size, connectivity density, and stimulus representation (e.g., number of input neurons per stimulus) so that the reported dynamics can be reproduced or compared with other AC implementations.
Simulated Author's Rebuttal
We thank the referee for the constructive comments, which highlight areas where our presentation can be strengthened. We address each major comment below and will revise the manuscript to include the requested quantitative details and analyses.
read point-by-point responses
-
Referee: [Abstract and Results] Abstract and Results sections: the claims of 'superior' recovery rates and 'network's own dynamics determine the size' are asserted without any reported quantitative metrics, error bars, statistical tests, network size N, stimulus encoding details, or exact E% value. No tables or figures compare recovery percentages or assembly-size distributions between E%-WTA and the original k-WTA model, rendering the improvement unverifiable.
Authors: We agree that the abstract and high-level results summary present the claims qualitatively. The full results section contains direct comparisons of recovery rates and assembly sizes, but to make these verifiable we will add explicit quantitative metrics (including mean recovery percentages with error bars), statistical tests, network size N, stimulus encoding details, and the exact E% value. A new table and figure will directly compare recovery percentages and assembly-size distributions between E%-WTA and k-WTA models. These additions will be included in the revised manuscript. revision: yes
-
Referee: [Methods] Methods and Model Definition: E% is introduced as a fixed hyper-parameter (analogous to k). The claim that assembly size emerges independently of modeler choice therefore requires explicit evidence that size is insensitive to modest variations in E% once E/I balance is held constant, or that size scales with N according to gamma-cycle statistics rather than E. No such sensitivity analysis or scaling plot is provided.
Authors: E% is indeed a fixed parameter chosen to match gamma-oscillation statistics, but the model is designed so that assembly size is then governed by recurrent dynamics and the fixed E/I ratio rather than being prescribed directly. To support this, we will add a sensitivity analysis demonstrating that assembly size remains largely insensitive to modest variations in E% (with E/I balance held constant) and include scaling plots versus network size N that align with gamma-cycle statistics. These will appear in the revised Methods and Results sections. revision: yes
Circularity Check
No significant circularity in derivation chain
full rationale
The paper defines E%-WTA and E/I-ratio inhibition from external biological observations (gamma-cycle statistics and cortical neuron ratios) and compares simulation outcomes directly to the independent Assembly Calculus baseline. No equation reduces claimed assembly-size emergence or recovery-rate improvement to a fitted parameter renamed as prediction, a self-citation loop, or a definitional tautology; the central results rest on explicit simulation runs whose inputs (E%, network size, learning rules) remain distinct from the reported metrics.
Axiom & Free-Parameter Ledger
free parameters (2)
- E% threshold
- E/I inhibition scaling
axioms (2)
- standard math Hebbian learning: co-active neurons strengthen synapses
- domain assumption Neural activity follows power-law distributions consistent with gamma oscillations
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel contradicts?
contradictsCONTRADICTS: the theorem conflicts with this paper passage, or marks a claim that would need revision before publication.
the E%-winners-take-all (E%-WTA) mechanism ... (1−ϵ)hmax(t)≤hj(t)≤hmax(t) ... Ft={j∈M|hj(t)∈[(1−ϵ)hmax(t),hmax(t)]}
-
IndisputableMonolith/Foundation/BranchSelection.leanRCLCombiner_isCoupling_iff unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
inhibition process based on the ratio between excitatory and inhibitory neurons ... pi=0.2
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
D. O. Hebb,The organization of behavior: A neuropsycho- logical theory. New York: Wiley, Jun. 1949
work page 1949
- [2]
-
[3]
Endogenous sequential cortical activity evoked by visual stimuli,
L. Carrillo-Reid, J.-E. K. Miller, J. P. Hamm, J. Jackson, and R. Yuste, “Endogenous sequential cortical activity evoked by visual stimuli,”J. Neurosci., vol. 35, no. 23, pp. 8813– 8828, Jun. 2015
work page 2015
-
[4]
Visual stimuli recruit intrinsically generated cortical ensem- bles,
J.-E. K. Miller, I. Ayzenshtat, L. Carrillo-Reid, and R. Yuste, “Visual stimuli recruit intrinsically generated cortical ensem- bles,”Proc. Natl. Acad. Sci. U. S. A., vol. 111, no. 38, pp. E4053–61, Sep. 2014
work page 2014
-
[5]
Imprinting and recalling cortical ensembles,
L. Carrillo-Reid, W. Yang, Y . Bando, D. S. Peterka, and R. Yuste, “Imprinting and recalling cortical ensembles,”Sci- ence, vol. 353, no. 6300, pp. 691–694, Aug. 2016
work page 2016
-
[6]
Controlling visually guided behavior by holographic re- calling of cortical ensembles,
L. Carrillo-Reid, S. Han, W. Yang, A. Akrouh, and R. Yuste, “Controlling visually guided behavior by holographic re- calling of cortical ensembles,”Cell, vol. 178, no. 2, pp. 447–457.e5, Jul. 2019
work page 2019
-
[7]
A theory for cerebral neocortex,
D. Marr, “A theory for cerebral neocortex,”Proc. R. Soc. Lond., vol. 176, no. 1043, pp. 161–234, Nov. 1970
work page 1970
-
[8]
Simple memory: a theory for archicortex,
D. Marr, “Simple memory: a theory for archicortex,”Phi- los. Trans. R. Soc. Lond. B Biol. Sci., vol. 262, no. 841, pp. 23–81, Jul. 1971
work page 1971
-
[9]
Neuronal ensembles: Building blocks of neural circuits,
R. Yuste, R. Cossart, and E. Yaksi, “Neuronal ensembles: Building blocks of neural circuits,”Neuron, vol. 112, no. 6, pp. 875–892, Mar. 2024
work page 2024
-
[10]
Neural networks and physical systems with emergent collective computational abilities,
J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities,”Proc. Natl. Acad. Sci. U. S. A., vol. 79, no. 8, pp. 2554–2558, Apr. 1982
work page 1982
-
[11]
L. de Almeida, M. Idiart, and J. E. Lisman, “Memory re- trieval time and memory capacity of the CA3 network: role of gamma frequency oscillations,”Learn. Mem., vol. 14, no. 11, pp. 795–806, Nov. 2007
work page 2007
-
[12]
From the neuron doctrine to neural networks,
R. Yuste, “From the neuron doctrine to neural networks,” Nat. Rev. Neurosci., vol. 16, no. 8, pp. 487–497, Aug. 2015
work page 2015
-
[13]
Large-scale recording of neuronal ensembles,
G. Buzsáki, “Large-scale recording of neuronal ensembles,” Nat. Neurosci., vol. 7, no. 5, pp. 446–451, May 2004
work page 2004
-
[14]
Two-photon laser scanning fluorescence microscopy,
W. Denk, J. H. Strickler, and W. W. Webb, “Two-photon laser scanning fluorescence microscopy,”Science, vol. 248, no. 4951, pp. 73–76, Apr. 1990
work page 1990
-
[15]
N. Q&A, “Richard axel,”Neuron, vol. 99, no. 6, pp. 1110– 1112, Sep. 2018
work page 2018
-
[16]
Brain com- putation by assemblies of neurons,
C. H. Papadimitriou, S. S. Vempala, D. Mitropol- sky, M. Collins, and W. Maass, “Brain com- putation by assemblies of neurons,”Proceedings of the National Academy of Sciences, vol. 117, no. 25, pp. 14 464–14 472, 2020. [Online]. Available: https://www.pnas.org/doi/abs/10.1073/pnas.2001893117
-
[17]
Random Projection in the Brain and Computation with Assemblies of Neurons,
C. H. Papadimitriou and S. S. Vempala, “Random Projection in the Brain and Computation with Assemblies of Neurons,” in10th Innovations in Theoretical Computer Science Conference (ITCS 2019), ser. Leibniz International Proceedings in Informatics (LIPIcs), A. Blum, Ed., vol. 124. Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik, 2018, pp....
work page 2019
-
[18]
Long Term Memory and the Densest K-Subgraph Problem,
R. Legenstein, W. Maass, C. H. Papadimitriou, and S. S. Vempala, “Long Term Memory and the Densest K-Subgraph Problem,” in9th Innovations in The- oretical Computer Science Conference (ITCS 2018), ser. Leibniz International Proceedings in Informatics (LIPIcs), A. R. Karlin, Ed., vol. 94. Dagstuhl, Germany: Schloss Dagstuhl–Leibniz-Zentrum fuer In- formatik...
work page 2018
-
[19]
A biologically plausible parser,
D. Mitropolsky, M. J. Collins, and C. H. Papadim- itriou, “A biologically plausible parser,”Transactions of the Association for Computational Linguistics, vol. 9, pp. 1374–1388, 2021. [Online]. Available: https://aclanthology.org/2021.tacl-1.81/
work page 2021
-
[20]
Com- putation with sequences of assemblies in a model of the brain,
M. Dabagia, C. H. Papadimitriou, and S. S. Vempala, “Com- putation with sequences of assemblies in a model of the brain,”Neural Comput., vol. 37, no. 1, pp. 193–233, Dec. 2024
work page 2024
-
[21]
Effects of plasticity func- tions on neural assemblies,
C. Constantinides and K. Nassar, “Effects of plasticity func- tions on neural assemblies,”arXiv, 2021
work page 2021
-
[22]
Understanding the role of recur- rent connections in assembly calculus,
A. Rangamani and Y . Xie, “Understanding the role of recur- rent connections in assembly calculus,” 07/2022 2022
work page 2022
-
[23]
L. de Almeida, M. Idiart, and J. E. Lisman, “A second func- tion of gamma frequency oscillations: An e%-max winner- take-all mechanism selects which cells fire,”Journal of Neu- roscience, vol. 29, no. 23, pp. 7497–7503, 2009. [Online]. Available: https://www.jneurosci.org/content/29/23/7497
work page 2009
-
[24]
Thermodynamics and signatures of criticality in a network of neurons,
G. Tka ˇcik, T. Mora, O. Marre, D. Amodei, S. E. Palmer, M. J. B. II, and W. Bialek, “Thermodynamics and signatures of criticality in a network of neurons,” Proceedings of the National Academy of Sciences, vol. 112, no. 37, pp. 11 508–11 513, 2015. [Online]. Available: https://www.pnas.org/doi/10.1073/pnas.1514188112
-
[25]
Statistical mechanics for networks of real neurons,
Anonymous, “Statistical mechanics for networks of real neurons,”Rev. Mod. Phys., Apr. 2025
work page 2025
-
[26]
P. Fries, D. Nikoli ´c, and W. Singer, “The gamma cycle,” Trends Neurosci., vol. 30, no. 7, pp. 309–316, Jul. 2007
work page 2007
-
[27]
Long term memory and the densest k-subgraph problem,
R. Legenstein, W. Maass, C. Papapdimitriou, and S. Vem- pala, “Long term memory and the densest k-subgraph problem,” in9th Innovations in Theoretical Computer Sci- ence Conference (ITCS 2018), ser. LIPIcs-Leibniz Inter- national Proceedings in Informatics, vol. 94. Germany: Schloss Dagstuhl - Leibniz-Zentrum für Informatik, 2018, p. 57:1–57:15
work page 2018
-
[28]
Mechanisms of gamma oscillations,
G. Buzsáki and X.-J. Wang, “Mechanisms of gamma oscillations,”Annual Review of Neuroscience, vol. 35, no. 1, pp. 203–225, 2012, pMID: 22443509. [Online]. Available: https://doi.org/10.1146/annurev-neuro-062111-150444
-
[29]
The gamma rhythm as a guardian of brain health,
A. M. Ichim, H. Barzan, V . V . Moca, A. Nagy-Dabacan, A. Ciuparu, A. Hapca, K. Vervaeke, and R. C. Muresan, “The gamma rhythm as a guardian of brain health,”eLife, vol. 13, p. e100238, nov 2024. [Online]. Available: https://doi.org/10.7554/eLife.100238
-
[30]
Stimulus-specific neuronal os- cillations in orientation columns of cat visual cortex,
C. M. Gray and W. Singer, “Stimulus-specific neuronal os- cillations in orientation columns of cat visual cortex,”Proc. Natl. Acad. Sci. U. S. A., vol. 86, no. 5, pp. 1698–1702, Mar. 1989
work page 1989
-
[31]
Modulation of oscillatory neuronal synchronization by se- lective visual attention,
P. Fries, J. H. Reynolds, A. E. Rorie, and R. Desimone, “Modulation of oscillatory neuronal synchronization by se- lective visual attention,”Science, vol. 291, no. 5508, pp. 1560–1563, Feb. 2001
work page 2001
-
[32]
Human gamma- frequency oscillations associated with attention and mem- ory,
O. Jensen, J. Kaiser, and J.-P. Lachaux, “Human gamma- frequency oscillations associated with attention and mem- ory,”Trends Neurosci., vol. 30, no. 7, pp. 317–324, Jul. 2007
work page 2007
-
[33]
Hippocampal gamma oscillations in- crease with memory load,
M. K. van Vugt, A. Schulze-Bonhage, B. Litt, A. Brandt, and M. J. Kahana, “Hippocampal gamma oscillations in- crease with memory load,”J. Neurosci., vol. 30, no. 7, pp. 2694–2699, Feb. 2010
work page 2010
-
[34]
Gamma oscillations and episodic memory,
B. J. Griffiths and O. Jensen, “Gamma oscillations and episodic memory,”Trends Neurosci., vol. 46, no. 10, pp. 832–846, Oct. 2023
work page 2023
-
[35]
S. Sadeh and C. Clopath, “Excitatory-inhibitory balance modulates the formation and dynamics of neuronal assem- blies in cortical networks,”Sci. Adv., vol. 7, no. 45, p. eabg8411, Nov. 2021
work page 2021
-
[36]
Synaptic E-I balance underlies efficient neural coding,
S. Zhou and Y . Yu, “Synaptic E-I balance underlies efficient neural coding,”Front. Neurosci., vol. 12, Feb. 2018
work page 2018
-
[37]
Neuronal circuits overcome imbalance in excitation and inhibition by adjusting connection num- bers,
N. Sukenik, O. Vinogradov, E. Weinreb, M. Segal, A. Lev- ina, and E. Moses, “Neuronal circuits overcome imbalance in excitation and inhibition by adjusting connection num- bers,”Proc. Natl. Acad. Sci. U. S. A., vol. 118, no. 12, p. e2018459118, Mar. 2021
work page 2021
-
[38]
A. Alreja, I. Nemenman, and C. J. Rozell, “Constrained brain volume in an efficient coding model explains the frac- tion of excitatory and inhibitory neurons in sensory cortices,” PLoS Comput. Biol., vol. 18, no. 1, p. e1009642, Jan. 2022
work page 2022
-
[39]
S. Sahara, Y . Yanagawa, D. D. M. O’Leary, and C. F. Stevens, “The fraction of cortical GABAergic neurons is constant from near the start of cortical neurogenesis to adult- hood,”J. Neurosci., vol. 32, no. 14, pp. 4755–4761, Apr. 2012
work page 2012
-
[40]
Could electrical coupling contribute to the for- mation of cell assemblies?
R. D. Traub, M. A. Whittington, N. Maier, D. Schmitz, and J. I. Nagy, “Could electrical coupling contribute to the for- mation of cell assemblies?”Rev. Neurosci., vol. 31, no. 2, pp. 121–141, Jan. 2020
work page 2020
-
[41]
Inhibitory connectivity defines the realm of excitatory plasticity,
G. Mongillo, S. Rumpel, and Y . Loewenstein, “Inhibitory connectivity defines the realm of excitatory plasticity,”Nat. Neurosci., vol. 21, no. 10, pp. 1463–1470, Oct. 2018
work page 2018
-
[42]
Overcoming catastrophic forget- ting in neural networks,
J. Kirkpatrick, R. Pascanu, N. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska, D. Hassabis, C. Clopath, D. Ku- maran, and R. Hadsell, “Overcoming catastrophic forget- ting in neural networks,”Proc. Natl. Acad. Sci. U. S. A., vol. 114, no. 13, pp. 3521–3526, Mar. 2017. 9
work page 2017
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.