pith. sign in

arxiv: 2211.11346 · v2 · submitted 2022-11-21 · 🧬 q-bio.NC

Hierarchically Modular Dynamical Neural Network Relaxing in a Warped Space: Basic Model and its Characteristics

Pith reviewed 2026-05-24 10:57 UTC · model grok-4.3

classification 🧬 q-bio.NC
keywords dynamical neural networkwarped spacehierarchical modularityassociation modelearning modeLissajous curvesenergy minimizationrelaxation trajectory
0
0 comments X

The pith

Neural network state variables relax in a warped space due to cooperation between dynamic and static neurons.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper introduces a hierarchically modular dynamical neural network that minimizes a designed energy function with internal and external spaces connected by a layered internetwork of static neurons. Dynamical neurons with large time constants in the internal space set the time-course, while the cooperation with static neurons warps the space in which relaxation occurs. In learning mode, weights are updated by strong inputs from repetitive bursting signals forming mappings like Lissajous curves. In association mode, this leads to varying convergence speeds and thus curved trajectories to goal points in nonlinear cases. A constrained mode allows generating output trajectories from given targets via inverse mapping.

Core claim

The model offers a framework in which state variables in the network relax in a warped space, due to the cooperation between dynamic and static neurons. In the association mode, the speed of convergence to a goal point greatly varies with the mapping relationship of the previously trained internetwork, and owing to this property, the convergence trajectory in the two-dimensional model with the non-linear mapping internetwork cannot go straight but instead must curve.

What carries the argument

The layered internetwork consisting of forward and backward subnets of static neurons connecting internal and external spaces, with dynamical neurons determining time-course.

If this is right

  • The convergence trajectory curves in two-dimensional models with nonlinear mappings.
  • An output trajectory is generated in the internal space mapped from the external space according to the inverse of the forward subnet mapping.
  • The system operates in learning mode with feedback paths and input ports present, or association mode otherwise.
  • Convergence speed to goal points varies with the trained internetwork mapping.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Such warping could allow neural models to naturally handle curved paths in tasks like motor control without explicit programming.
  • The use of bursting signals for learning mappings might connect to biological rhythm-based learning mechanisms.
  • Extending to higher dimensions could produce more complex warped relaxation behaviors for multi-variable problems.

Load-bearing premise

Synaptic weights in the internetwork are modified by strong inputs from repetitive neuronal bursting to produce two-dimensional mappings based on the Lissajous curve principle.

What would settle it

Simulating or implementing the two-dimensional model with a nonlinear mapping and checking if the convergence trajectory from a starting point to the goal curves instead of going straight.

Figures

Figures reproduced from arXiv: 2211.11346 by Ernst Niebur, Kazuyoshi Tsutsumi.

Figure 1
Figure 1. Figure 1: A block diagram of the network described by Eq. (13). Con [PITH_FULL_IMAGE:figures/full_fig_p006_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Architecture of the proposed network described by Eqs [PITH_FULL_IMAGE:figures/full_fig_p009_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Basically, the model is topologically grouped into two types, [PITH_FULL_IMAGE:figures/full_fig_p010_3.png] view at source ↗
Figure 3
Figure 3. Figure 3: Thus, the following condition in Eq. (29) is presumed in conjunc [PITH_FULL_IMAGE:figures/full_fig_p011_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Simulation results for the Linear Case of the Learning Mode [PITH_FULL_IMAGE:figures/full_fig_p012_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Three sets of sinusoidal and quasi-sinusoidal signals supp [PITH_FULL_IMAGE:figures/full_fig_p013_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Simulation results for the Contractive Case of the Learnin [PITH_FULL_IMAGE:figures/full_fig_p014_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Simulation results for the Expansive Case of the Learning M [PITH_FULL_IMAGE:figures/full_fig_p015_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Relationship between two kinds of sinusoidal waves with diffe [PITH_FULL_IMAGE:figures/full_fig_p017_8.png] view at source ↗
Figure 9
Figure 9. Figure 9: Simulation results for the Linear Case of the Learning Mode [PITH_FULL_IMAGE:figures/full_fig_p018_9.png] view at source ↗
Figure 10
Figure 10. Figure 10: Relationship between two kinds of quasi-sinusoidal waves [PITH_FULL_IMAGE:figures/full_fig_p019_10.png] view at source ↗
Figure 11
Figure 11. Figure 11: Simulation results for the Contractive Case of the Learn [PITH_FULL_IMAGE:figures/full_fig_p020_11.png] view at source ↗
Figure 12
Figure 12. Figure 12: Relationship between two kinds of quasi-sinusoidal waves [PITH_FULL_IMAGE:figures/full_fig_p021_12.png] view at source ↗
Figure 13
Figure 13. Figure 13: Simulation results for the Expansive Case of the Learning [PITH_FULL_IMAGE:figures/full_fig_p022_13.png] view at source ↗
Figure 14
Figure 14. Figure 14: Simulation results for the Expansive Case of the Learning [PITH_FULL_IMAGE:figures/full_fig_p024_14.png] view at source ↗
Figure 15
Figure 15. Figure 15: Simulation results for Type #0 of the Association Mode in th [PITH_FULL_IMAGE:figures/full_fig_p025_15.png] view at source ↗
Figure 16
Figure 16. Figure 16: A conceptual diagram and graphs describing signal flows [PITH_FULL_IMAGE:figures/full_fig_p026_16.png] view at source ↗
Figure 17
Figure 17. Figure 17: Simulation results for Type #1 of the Association Mode in th [PITH_FULL_IMAGE:figures/full_fig_p027_17.png] view at source ↗
Figure 18
Figure 18. Figure 18: Simulation results for Type #0 of the Association Mode in th [PITH_FULL_IMAGE:figures/full_fig_p029_18.png] view at source ↗
Figure 19
Figure 19. Figure 19: Simulation results for Type #1 of the Association Mode in th [PITH_FULL_IMAGE:figures/full_fig_p031_19.png] view at source ↗
Figure 20
Figure 20. Figure 20: Three target trajectories with different speeds (time c [PITH_FULL_IMAGE:figures/full_fig_p033_20.png] view at source ↗
Figure 21
Figure 21. Figure 21: Simulation results for Type #0 of the Constrained Associa [PITH_FULL_IMAGE:figures/full_fig_p035_21.png] view at source ↗
Figure 22
Figure 22. Figure 22: Simulation results for Type #1 of the Constrained Associa [PITH_FULL_IMAGE:figures/full_fig_p036_22.png] view at source ↗
read the original abstract

We propose a hierarchically modular, dynamical neural network model whose architecture minimizes a specifically designed energy function and defines its temporal characteristics. The model has an internal and an external space that are connected with a layered internetwork that consists of a pair of forward and backward subnets composed of static neurons (with an instantaneous time-course). Dynamical neurons with large time constants in the internal space determine the overall time-course. The model offers a framework in which state variables in the network relax in a warped space, due to the cooperation between dynamic and static neurons. We assume that the system operates in either a learning or an association mode, depending on the presence or absence of feedback paths and input ports. In the learning mode, synaptic weights in the internetwork are modified by strong inputs corresponding to repetitive neuronal bursting, which represents sinusoidal or quasi-sinusoidal waves in the short-term average density of nerve impulses or in the membrane potential. A two-dimensional mapping relationship can be formed by employing signals with different frequencies based on the same mechanism as Lissajous curves. In the association mode, the speed of convergence to a goal point greatly varies with the mapping relationship of the previously trained internetwork, and owing to this property, the convergence trajectory in the two-dimensional model with the non-linear mapping internetwork cannot go straight but instead must curve. We further introduce a constrained association mode with a given target trajectory and elucidate that in the internal space, an output trajectory is generated, which is mapped from the external space according to the inverse of the mapping relationship of the forward subnet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

3 major / 1 minor

Summary. The manuscript proposes a hierarchically modular dynamical neural network whose architecture minimizes a designed energy function. Internal and external spaces are linked by forward/backward subnets of static neurons; dynamical neurons with large time constants govern the time course. The model is claimed to relax state variables in a warped space via cooperation between neuron types. In learning mode, internetwork weights are updated by repetitive bursting inputs (sinusoidal/quasi-sinusoidal) to produce 2-D mappings analogous to Lissajous curves; in association mode the resulting non-linear mapping forces curved convergence trajectories, while a constrained mode generates output trajectories that are inverses of the forward mapping.

Significance. If the missing formal definitions, update rules, and derivations were supplied and the claimed behaviors verified, the framework could supply a concrete mechanism linking bursting-driven learning to warped relaxation and curved trajectories, offering a new modeling approach for associative dynamics in computational neuroscience.

major comments (3)
  1. [Abstract] Abstract: the claim that 'synaptic weights in the internetwork are modified by strong inputs corresponding to repetitive neuronal bursting' to form a two-dimensional mapping 'based on the same mechanism as Lissajous curves' supplies neither the explicit weight-update rule nor an analytic derivation showing that the resulting forward mapping is non-linear and invertible in the manner required to warp the relaxation paths.
  2. [Abstract] Abstract: the assertion that 'the convergence trajectory in the two-dimensional model with the non-linear mapping internetwork cannot go straight but instead must curve' is stated without any simulation, numerical example, or proof that the cooperation between dynamical and static neurons under the (undefined) energy function produces this geometry.
  3. [Abstract] Abstract: no equations are given for the energy function that the architecture is said to minimize, for the time constants of the dynamical neurons, or for the forward/backward subnet mappings, rendering the central 'warped space' relaxation claim unverifiable.
minor comments (1)
  1. The manuscript would benefit from at least one diagram showing the layered internetwork, the internal/external spaces, and an example of a curved trajectory under the claimed mapping.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the constructive and detailed comments. We address each major comment below, clarifying where the manuscript already provides the requested elements and indicating revisions to improve accessibility and explicitness.

read point-by-point responses
  1. Referee: [Abstract] Abstract: the claim that 'synaptic weights in the internetwork are modified by strong inputs corresponding to repetitive neuronal bursting' to form a two-dimensional mapping 'based on the same mechanism as Lissajous curves' supplies neither the explicit weight-update rule nor an analytic derivation showing that the resulting forward mapping is non-linear and invertible in the manner required to warp the relaxation paths.

    Authors: The weight-update rule is specified in the learning-mode section of the main text as a correlation-based modification driven by the short-term average impulse density of the bursting inputs. We agree that an explicit analytic derivation of the resulting non-linear mapping and its invertibility would strengthen the abstract's claim and will add a concise derivation (showing the frequency-dependent Lissajous-like composition and the paired forward/backward subnet construction) to the revised manuscript. revision: yes

  2. Referee: [Abstract] Abstract: the assertion that 'the convergence trajectory in the two-dimensional model with the non-linear mapping internetwork cannot go straight but instead must curve' is stated without any simulation, numerical example, or proof that the cooperation between dynamical and static neurons under the (undefined) energy function produces this geometry.

    Authors: Numerical simulations of the curved trajectories under the non-linear mapping are shown in the Results section, arising directly from the minimization dynamics of the energy function when the static-neuron mapping warps the relaxation path. We will insert a brief reference to these simulations and a short geometric explanation in the revised abstract. revision: partial

  3. Referee: [Abstract] Abstract: no equations are given for the energy function that the architecture is said to minimize, for the time constants of the dynamical neurons, or for the forward/backward subnet mappings, rendering the central 'warped space' relaxation claim unverifiable.

    Authors: The energy function is defined in Equation (1), the large time constants of the dynamical neurons are stated in Section 2.1, and the forward/backward mappings are given by the linear transformations realized by the static-neuron subnets. We will revise the abstract to include explicit pointers to these equations and definitions so that the warped-space claim is immediately verifiable from the abstract. revision: yes

Circularity Check

0 steps flagged

No circularity: model behaviors follow from explicit definitions and assumptions without reduction to tautology.

full rationale

The paper defines a custom energy function, layered internetwork architecture, and learning/association modes with explicit assumptions about bursting-driven weight updates and Lissajous-based mappings. Claimed properties such as warped-space relaxation and curved trajectories are direct consequences of these model choices rather than independent predictions that collapse back to fitted inputs or self-citations by construction. No load-bearing derivation step equates a result to its own inputs; the framework is self-contained as a theoretical proposal.

Axiom & Free-Parameter Ledger

2 free parameters · 2 axioms · 2 invented entities

The central claims rest on an energy-minimization principle, the existence of distinct internal/external spaces, and the assumption that bursting inputs modify weights to produce Lissajous-style mappings; no independent evidence for these modeling choices is supplied.

free parameters (2)
  • time constants of dynamical neurons
    Large time constants are introduced to determine overall time-course; specific values are not given but are required for the separation of dynamic and static behavior.
  • mapping relationship of the internetwork
    The non-linear mapping is trained from frequency signals and directly controls convergence speed and trajectory curvature; it functions as a fitted transformation.
axioms (2)
  • domain assumption The system minimizes a specifically designed energy function that defines its temporal characteristics.
    Invoked to justify relaxation behavior in both modes.
  • ad hoc to paper Repetitive neuronal bursting represents sinusoidal or quasi-sinusoidal waves that modify synaptic weights.
    Central to the learning mode and 2D mapping formation.
invented entities (2)
  • warped space no independent evidence
    purpose: The space in which state variables relax due to dynamic-static neuron cooperation.
    Postulated to explain non-straight trajectories; no independent falsifiable handle supplied.
  • internal and external spaces connected by layered internetwork no independent evidence
    purpose: Hierarchical separation of slow dynamical and fast static computation.
    Core architectural invention required for the claimed modes.

pith-pipeline@v0.9.0 · 5822 in / 1716 out tokens · 23634 ms · 2026-05-24T10:57:11.515668+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Relaxing in Warped Spaces: Generalized Hierarchical and Modular Dynamical Neural Network

    q-bio.NC 2026-04 unverdicted novelty 5.0

    A new dynamical neural network architecture with hierarchical subspaces and forward-backward internetworks allows state variables to relax in warped spaces, forming mappings from periodic inputs and implying an input-...

Reference graph

Works this paper leans on

67 extracted references · 67 canonical work pages · cited by 1 Pith paper

  1. [1]

    Modeling and complexity in neural networks

    Aihara, K., and Ichinose, N. Modeling and complexity in neural networks. Artificial Life and Robotics 3 (1999), 148–154

  2. [2]

    Theory of adaptive pattern classifiers

    Amari, S.-I. Theory of adaptive pattern classifiers. IEEE Transactions on Electronic Computers 16 (1967), 299–307. Kazuyoshi Tsutsumi & Ernst Niebur 41

  3. [3]

    Neural theory of association and concept-formation

    Amari, S.-I. Neural theory of association and concept-formation. Biological Cybernetics 26 (1977), 175–185

  4. [4]

    Block, H. D. The perceptron: A model for brain functioning. I. Reviews of Modern Physics 34 (1962), 123–135

  5. [5]

    Generating exponentially stable states for a Hopfield Neural Network

    Cabrera, E., and Sossa, H. Generating exponentially stable states for a Hopfield Neural Network. Neurocomputing 275 (2018), 358–365

  6. [6]

    A., Cohen, M

    Carpenter, G. A., Cohen, M. A., Grossberg, S.; Kohonen, T., O ja, E.; Palm, G. H. J. J., and Tank, D. W. Technical comments: computing with neural networks. Science 235 (1987), 1226–1229

  7. [7]

    Metalearning and neuromodulation

    Doya, K. Metalearning and neuromodulation. Neural Networks 15 (2002), 495–506

  8. [8]

    Mathematical models of threshold phenomena in the nerve membran e

    FitzHugh, R. Mathematical models of threshold phenomena in the nerve membran e. Bulletin of Mathematical Biophysics 17 (1955), 257–278

  9. [9]

    The usefulness of useless knowledge

    Flexner, A., and Dijkgraaf, R. The usefulness of useless knowledge . Princeton University Press, 2017

  10. [10]

    Congnitron: A self-organizing multilayered neural network

    Fukushima, K. Congnitron: A self-organizing multilayered neural network. Biological Cybernetics 20 (1975), 121–136

  11. [11]

    Neocognitron: A self-organizing neural network model for a mech anism of pattern recognition unaffected by shift in position

    Fukushima, K. Neocognitron: A self-organizing neural network model for a mech anism of pattern recognition unaffected by shift in position. Biological Cybernetics 36 (1980), 193–202

  12. [12]

    A neural network model for selective attention in visual pattern r ecog- nition

    Fukushima, K. A neural network model for selective attention in visual pattern r ecog- nition. Biological Cybernetics 55 (1986), 5–15

  13. [13]

    Artificial vision by multi-layered neural networks: Neocognitron an d its advances

    Fukushima, K. Artificial vision by multi-layered neural networks: Neocognitron an d its advances. Neural Networks 37 (2013), 103–119

  14. [14]

    Neocognitron: A neural network model for a mechanism of visual pattern recognition

    Fukushima, K., Miyake, S., and Ito, T. Neocognitron: A neural network model for a mechanism of visual pattern recognition. IEEE Transactions on Systems, Man, and Cybernetics 13 (1983), 826–834

  15. [15]

    Adaptive pattern classification and universal recoding: I

    Grossberg, S. Adaptive pattern classification and universal recoding: I. parallel de- velopment and coding of neural feature detectors. Biological Cybernetics 23 (1976), 121–134

  16. [16]

    Adaptive resonance theory: How a brain learns to consciouly atten d, learn, and recognize a changing world

    Grossberg, S. Adaptive resonance theory: How a brain learns to consciouly atten d, learn, and recognize a changing world. Neural Networks 37 (2013), 1–47

  17. [17]

    Learning hierarchical informa- tion flow with recurrent neural modules

    Hafner, D., Irpan, A., Davidson, J., and Heess, N. Learning hierarchical informa- tion flow with recurrent neural modules. In Advances in Neural Information Processing Systems (NIPS) (2017), vol. 30

  18. [18]

    Hebb, D. O. The organization of behavior . New York: Wiley, 1949

  19. [19]

    Counterpropagation networks

    Hecht-Nielsen, R. Counterpropagation networks. In Proc. IEEE First International Conference on Neural Networks (1987), vol. 2, pp. 19–32

  20. [20]

    Neurocomputing: Picking the human brain

    Hect-Nielsen, R. Neurocomputing: Picking the human brain. IEEE Spectrum (March 1988), 36–41

  21. [21]

    E., Osindero, S., and Teh, Y

    Hinton, G. E., Osindero, S., and Teh, Y. A fast learning algorithm for deep belief nets. Neural Computation 18 (2006), 1527–1554. 42 Relaxing in a Warped Space

  22. [22]

    Hinton, J., and Salakhutdinov, R. R. Reducing the dimensionality of data with neural networks. Science 313 (2006), 504–507

  23. [23]

    L., and Huxley, A

    Hodgkin, A. L., and Huxley, A. F. A quantitative description of membrane current and its application to conduction and excitation in nerve. The Journal of Physiology 117 (1952), 500–544

  24. [24]

    Hopfield, J. J. Neural networks and physical systems with emergent collective co m- putational abilities. In Proc. the National Academy of Sciences, U.S.A. (1982), vol. 79, pp. 2554–2558

  25. [25]

    Hopfield, J. J. Neurons with graded response have collective computational prop erties like those of two-state neurons. In Proc. the National Academy of Science, U.S.A. (1984), vol. 81, pp. 3088–3092

  26. [26]

    J., and Tank, D

    Hopfield, J. J., and Tank, D. W. “neural” computation of decisions in optimization problems. Biological Cybernetics 52 (1985), 141–152

  27. [27]

    H., and Wiesel, T

    Hubel, D. H., and Wiesel, T. N. Receptive fields of single neurones in the cat’s striate cortex. The Journal of Physiology 148 (1959), 574–591

  28. [28]

    Correlation matrix memories

    Kohonen, T. Correlation matrix memories. IEEE Transactions on Computers C-21 (1972), 353–359

  29. [29]

    Self-organized formation of topologically correct feature maps

    Kohonen, T. Self-organized formation of topologically correct feature maps. Biological Cybernetics 43 (1982), 59–69

  30. [30]

    Bidirectional associative memories

    Kosko, B. Bidirectional associative memories. IEEE Transactions on Systems, Man, and Cybernetics 18 (1988), 49–60

  31. [31]

    How many computers to identify cat? 16,000

    Markoff, J. How many computers to identify cat? 16,000. The New York Times, June 2012

  32. [32]

    Sustained oscillations generated by mutually inhibiting neurons with adaptation

    Matsuoka, K. Sustained oscillations generated by mutually inhibiting neurons with adaptation. Biological Cybernetics 52 (1985), 367–376

  33. [33]

    S., and Pitts, W

    McCulloch, W. S., and Pitts, W. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics 5 (1943), 115–133

  34. [34]

    Meunier, D., Lambiotte, R., and Bullmore, E. T. Modular and hierarchically modular organization of brain networks. Frontiers in Neuroscience 4 , Art.200 (2010)

  35. [35]

    Self-organized criti- cality occurs in non-conservative neuronal networks during ‘up’ s tates

    Millman, D., Mihalas, S., Kirkwood, A., and Niebur, E. Self-organized criti- cality occurs in non-conservative neuronal networks during ‘up’ s tates. Nature Physics 6 (2010), 801–805

  36. [36]

    Perceptrons

    Minsky, M., and Papert, S. Perceptrons. The MIT Press, Cambridge, MA, U.S.A., 1969

  37. [37]

    Analysis and simulation of networks of mutually inhibiting neurons

    Morishita, I., and Yajima, A. Analysis and simulation of networks of mutually inhibiting neurons. Kybernetik 11 (1972), 154–165

  38. [38]

    An active pulse transmission line simulating nerve axon

    Nagumo, J., Arimoto, S., and Yoshizawa, S. An active pulse transmission line simulating nerve axon. In Proc. IRE (1962), vol. 50, pp. 2061–2070

  39. [39]

    Associatron - a model of associative memory

    Nakano, K. Associatron - a model of associative memory. IEEE Transactions on Systems, Man, and Cybernetics 2 (1972), 380–388

  40. [40]

    Modular structure of brain functional networks: break- ing the resolution limit by surprise

    Nicolini, C., and Bifone, A. Modular structure of brain functional networks: break- ing the resolution limit by surprise. Scientific Reports 6 , Art.19250 (2016). Kazuyoshi Tsutsumi & Ernst Niebur 43

  41. [41]

    Computer simulation of networks of electrotonic neurons

    Niebur, E., and Erdos, P. Computer simulation of networks of electrotonic neurons. In Computer simulation in brain science , R. M. J. Cotterill, Ed. Cambridge University Press, Cambridge, UK, 1988, pp. 148–163

  42. [42]

    A multitask learning model for online pattern recognition

    Ozawa, S., Roy, A., and Roussinov, D. A multitask learning model for online pattern recognition. IEEE Transactions on Neural Networks 20 (2009), 430–445

  43. [43]

    An artificial modular neural network and its basic dynamical characteristics

    Ozawa, S., Tsutsumi, K., and Baba, N. An artificial modular neural network and its basic dynamical characteristics. Biological Cybernetics 78 (1998), 19–36

  44. [44]

    Criticality in neural systems

    Plenz, D., and Niebur, E. Criticality in neural systems . Wiley VCH, 2014

  45. [45]

    The perceptron: A probabilistic model for information storage and organization in the brain

    Rosenblatt, F. The perceptron: A probabilistic model for information storage and organization in the brain. Psychological Review 65 (1958), 386–408

  46. [46]

    E., Hinton, G

    Rumelhart, D. E., Hinton, G. E., and Williams, R. J. Learning internal repre- sentation by error propagation. In Parallel distributed processing: Explorations in the microstructures of cognition , D. E. Rumelhart and J. L. McClelland, Eds., vol. 1. The MIT Press, Cambridge, MA, U.S.A., 1986, pp. 318–362

  47. [47]

    E., Hinton, G

    Rumelhart, D. E., Hinton, G. E., and Williams, R. J. Learning representations by back-propogating errors. Nature 323 (1986), 533–536

  48. [48]

    Steinbuch, K., and Piske, U. A. W. Learning matrices and their applications. IEEE Transactions on Electronic Computers 12 (1963), 846–862

  49. [49]

    W., and Hopfield, J

    Tank, D. W., and Hopfield, J. J. Simple ‘neural’ optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit. IEEE Transactions on Circuit and Systems 33 (1986), 533–541

  50. [50]

    Decentralized autonomous control of a quadruped locomotion robot

    Tsujita, K., Tsuchiya, K., and Onat, A. Decentralized autonomous control of a quadruped locomotion robot. Artificial Life and Robotics 5 (2003), 152–158

  51. [51]

    Neural control of 3-dimentional truss structure

    Tsutsumi, K. Neural control of 3-dimentional truss structure. Neural Networks 1 , Supl. 1 (1988), 364

  52. [52]

    A multi-layered neural network composed of back-prop

    Tsutsumi, K. A multi-layered neural network composed of back-prop. and Hopfi eld nets and internal space representation. In Proc. International Joint Conference on Neural Networks (1989), pp. 365–371

  53. [53]

    Cross-Coupled Hopfield Nets via generalized-delta-rule-based inte rnet- works

    Tsutsumi, K. Cross-Coupled Hopfield Nets via generalized-delta-rule-based inte rnet- works. In Proc. International Joint Conference on Neural Networks (1990), vol. 2, pp. 259–265

  54. [54]

    Higher degree error backpropagation in cross-coupled Hopfield ne ts

    Tsutsumi, K. Higher degree error backpropagation in cross-coupled Hopfield ne ts. In Proc. International Joint Conference on Neural Networks (1991), vol. 2, pp. 349–355

  55. [55]

    On redundancy in neural architecture: dynamics of a simple module- based neural network and initial-state independence

    Tsutsumi, K. On redundancy in neural architecture: dynamics of a simple module- based neural network and initial-state independence. Neural Networks 12 (1999), 1075– 1085

  56. [56]

    Relaxing in a warped space: An effect due to the cooperation of stat ic and dynamical neurons

    Tsutsumi, K. Relaxing in a warped space: An effect due to the cooperation of stat ic and dynamical neurons. In Proc. International Joint Conference on Neural Networks (2003), pp. 897–901

  57. [57]

    Neural computation for con- trolling the configuration of 2-dimentional truss structure

    Tsutsumi, K., Katayama, K., and Matsumoto, H. Neural computation for con- trolling the configuration of 2-dimentional truss structure. In Proc. the IEEE Annual International Conference on Neural Networks (1988), pp. 575–586. 44 Relaxing in a Warped Space

  58. [58]

    Ring neural network qua a generator of rhythmic oscillation with period control mechanism

    Tsutsumi, K., and Matsumoto, H. Ring neural network qua a generator of rhythmic oscillation with period control mechanism. Biological Cybernetics 51 (1984), 181–194

  59. [59]

    A synaptic modification algorithm in consid- eration of the generation of rhythmic oscillation in a ring neural netw ork

    Tsutsumi, K., and Matsumoto, H. A synaptic modification algorithm in consid- eration of the generation of rhythmic oscillation in a ring neural netw ork. Biological Cybernetics 50 (1984), 419–430

  60. [60]

    Neural computation and learning strategy for manipulator position control

    Tsutsumi, K., and Matsumoto, H. Neural computation and learning strategy for manipulator position control. In Proc. the IEEE First Annual International Conference on Neural Networks (1987), vol. 4, pp. 525–534

  61. [61]

    A synaptic modification algorithm and rhythmic oscillation

    Tsutsumi, K., and Matsumoto, H. A synaptic modification algorithm and rhythmic oscillation. In Computer simulation in brain science , R. M. J. Cotterill, Ed. Cambridge University Press, Cambridge, UK, 1988, pp. 268–292

  62. [62]

    Maximum/minimum detection by a module-based neural network with redundant architecture

    Tsutsumi, K., and Nakajima, K. Maximum/minimum detection by a module-based neural network with redundant architecture. In Proc. International Joint Conference on Neural Networks (1999), p. 792: Session: 3.4

  63. [63]

    Dynamics and local minima of a simple neural network for optimization

    Tsutsumi, K., and Nakajima, K. Dynamics and local minima of a simple neural network for optimization. In Proc. International Joint Conference on Neural Networks (2001), pp. 353–358

  64. [64]

    Werbos, P. J. Beyond regression: New tools for prediction and analysis in the behav- ioral sciences. PhD thesis, Harvard University, 1974

  65. [65]

    Widrow, B., and Hoff, M. E. Adaptive switching circuits. In IRE WESCON Convention Record (1960), pp. 96–104

  66. [66]

    J., and Zipser, D

    Williams, R. J., and Zipser, D. Gradient-based learning algorithms for recurrent connectionist networks. Tech. Rep. Tech. Rep. NU-CCS-90-9, C ollege of Computer Science, Northeastern University, Boston, MA, U.S.A., 1990

  67. [67]

    J., and Zipser, D

    Williams, R. J., and Zipser, D. Gradient-based learning algorithms for recurrent networks and their computational complexity. In Back-propagation: theory, architectures and applications , Y. Chauvin and D. E. Rumelhart, Eds. L. Erlbaum Associates Inc., Hillsdale, NJ, U.S.A., 1995, pp. 433–486. Acknowledgements: This work was supported in part by Ryukoku U...