In the strong-timescale-separation limit, fast-to-slow couplings do not create statistical dependence between layers, while slow-to-fast feedback couplings do, and can propagate along minimal network paths.
Multiscale nonlinear integration drives accurate encoding of input information
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Biological and artificial systems encode information through several complex nonlinear operations, making their exact study a formidable challenge. These internal mechanisms often take place across multiple timescales and process external signals to enable functional output responses. In this work, we focus on two widely implemented paradigms: nonlinear summation, where signals are first processed independently and then combined; and nonlinear integration, where they are combined first and then processed. We study a general model where the input signal is propagated to an output unit through a processing layer via nonlinear activation functions. Further, we distinguish between the two cases of fast and slow processing timescales. We demonstrate that integration and fast-processing capabilities systematically enhance input-output mutual information over a wide range of parameters and system sizes, while simultaneously enabling tunable input discrimination. Moreover, we reveal that high-dimensional embeddings and low-dimensional projections emerge naturally as optimal competing strategies. Our results uncover the foundational features of nonlinear information processing with profound implications for both biological and artificial systems.
citation-role summary
citation-polarity summary
fields
cond-mat.stat-mech 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Stochastic processes with multiple temporal scales: timescale separation and information
In the strong-timescale-separation limit, fast-to-slow couplings do not create statistical dependence between layers, while slow-to-fast feedback couplings do, and can propagate along minimal network paths.