pith. sign in

arxiv: 1907.05106 · v1 · pith:OFXNT4RLnew · submitted 2019-07-11 · 💻 cs.LG · stat.ML

Spatiotemporal Local Propagation

Pith reviewed 2026-05-24 22:58 UTC · model grok-4.3

classification 💻 cs.LG stat.ML
keywords neural computationleast action principlelocal propagationbiological plausibilitybackpropagationrecurrent learningvariational methodsdirected graphs
0
0 comments X

The pith

Neural networks on any digraph can compute with updates that are local in both space and time by following a least-action variational principle.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper rethinks neural computation by drawing a parallel to physical laws expressed in the variational least-action framework. Network connections are incorporated through an appropriate Lagrangian term, which produces a computational scheme called SpatioTemporal Local Propagation that avoids any backpropagation of error signals. Temporal locality follows directly from the variational formulation itself. The resulting scheme therefore satisfies locality in both space and time, a combination that standard backpropagation, backpropagation through time, and real-time recurrent learning do not achieve. This locality is presented as the source of greater biological plausibility for networks defined on arbitrary directed graphs.

Core claim

Expressing network connections via an appropriate Lagrangian term in the variational least-action framework automatically produces a computational scheme that is local in space while the variational formulation guarantees temporal locality, without additional non-local mechanisms, for neural networks based on any digraph.

What carries the argument

SpatioTemporal Local Propagation (STLP) scheme, where space locality is obtained by expressing connections through a Lagrangian term that removes the need for error backpropagation and temporal locality arises from the variational formulation.

If this is right

  • The scheme requires no backpropagation of error signals across the network.
  • Both spatial and temporal locality hold simultaneously, unlike BPTT or RTRL.
  • The approach applies to neural networks defined on arbitrary directed graphs.
  • Biological plausibility is obtained directly from the locality properties rather than added separately.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Hardware realizations could avoid global broadcast of error signals and operate with only nearest-neighbor communication.
  • The same variational construction might be tested on continuous-time dynamical systems to check whether online learning remains local.
  • Recurrent architectures trained this way could be compared directly with BPTT on streaming tasks to measure any difference in stability or memory usage.

Load-bearing premise

That writing the network connections as a Lagrangian term inside the least-action variational problem will by itself generate update equations that remain strictly local in space and time.

What would settle it

Derive the explicit update equations from the variational principle for a small recurrent network and check whether any of those equations requires information from non-adjacent nodes or from future time steps.

read the original abstract

This paper proposes an in-depth re-thinking of neural computation that parallels apparently unrelated laws of physics, that are formulated in the variational framework of the least action principle. The theory holds for neural networks that are also based on any digraph, and the resulting computational scheme exhibits the intriguing property of being truly biologically plausible. The scheme, which is referred to as SpatioTemporal Local Propagation (STLP), is local in both space and time. Space locality comes from the expression of the network connections by an appropriate Lagrangian term, so as the corresponding computational scheme does not need the backpropagation (BP) of the error, while temporal locality is the outcome of the variational formulation of the problem. Overall, in addition to conquering the often invoked biological plausibility missed by BP, the locality in both space and time that arises from the proposed theory can neither be exhibited by Backpropagation Through Time (BPTT) nor by Real-Time Recurrent Learning (RTRL).

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 1 minor

Summary. The manuscript proposes a variational least-action framework for neural computation on arbitrary digraphs. It derives a scheme termed SpatioTemporal Local Propagation (STLP) whose update rules are asserted to be local in both space (no error back-propagation) and time (arising automatically from the variational formulation), thereby achieving biological plausibility that standard back-propagation, BPTT, and RTRL lack.

Significance. If the derivations are correct and the locality properties are rigorously established, the result would supply a parameter-free, biologically motivated alternative to back-propagation through time for recurrent networks. The explicit use of a Lagrangian term to encode connections and the claim of automatic temporal locality would constitute a substantive theoretical contribution.

major comments (2)
  1. [Abstract / main theoretical development] The central claim that the variational formulation automatically yields temporal locality is not substantiated by an explicit derivation of the discrete recurrence relations or by an analysis of boundary terms. The abstract asserts that “temporal locality is the outcome of the variational formulation,” yet the manuscript supplies no Euler-Lagrange equations, no discrete-time action integral, and no proof that the resulting update rules remain strictly local once fixed boundary conditions or trajectory minimization are imposed (see skeptic note on non-local dependencies).
  2. [Abstract / main theoretical development] Spatial locality is said to follow from “an appropriate Lagrangian term” for the connections, but the manuscript does not exhibit the concrete form of that term, the resulting stationarity conditions, or a direct comparison showing that no non-local error propagation appears in the update equations.
minor comments (1)
  1. The abstract contains no equations, no concrete network example, and no experimental results, making immediate verification of the locality claims impossible.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the detailed and constructive report. The comments correctly identify that the original manuscript would benefit from more explicit derivations to substantiate the locality claims. We have revised the paper to include these elements while preserving the core variational framework.

read point-by-point responses
  1. Referee: [Abstract / main theoretical development] The central claim that the variational formulation automatically yields temporal locality is not substantiated by an explicit derivation of the discrete recurrence relations or by an analysis of boundary terms. The abstract asserts that “temporal locality is the outcome of the variational formulation,” yet the manuscript supplies no Euler-Lagrange equations, no discrete-time action integral, and no proof that the resulting update rules remain strictly local once fixed boundary conditions or trajectory minimization are imposed (see skeptic note on non-local dependencies).

    Authors: We agree that the original presentation would have been strengthened by an explicit step-by-step derivation. In the revised manuscript we now include: (i) the discrete-time action integral constructed from the Lagrangian, (ii) the full set of Euler-Lagrange stationarity conditions obtained by varying with respect to the network state trajectory, and (iii) an analysis showing that, once the boundary conditions at the final time are fixed, the resulting recurrence for the synaptic updates at time t depends only on quantities available at t and t−1. This confirms that no future information propagates backward in time, thereby establishing temporal locality directly from the variational principle. revision: yes

  2. Referee: [Abstract / main theoretical development] Spatial locality is said to follow from “an appropriate Lagrangian term” for the connections, but the manuscript does not exhibit the concrete form of that term, the resulting stationarity conditions, or a direct comparison showing that no non-local error propagation appears in the update equations.

    Authors: We accept the referee’s observation. The revised version now presents the explicit Lagrangian term that encodes the directed connections (a quadratic penalty on the difference between pre- and post-synaptic activations weighted by the adjacency matrix). We derive the corresponding stationarity condition and show that it yields a local update rule in which each synapse is modified using only the activations of its two incident neurons. A side-by-side comparison with the BPTT equations is included to demonstrate the absence of the non-local error back-propagation term. revision: yes

Circularity Check

1 steps flagged

Spatial locality built into Lagrangian term by construction; temporal locality asserted without shown independence from boundary terms

specific steps
  1. self definitional [Abstract]
    "Space locality comes from the expression of the network connections by an appropriate Lagrangian term, so as the corresponding computational scheme does not need the backpropagation (BP) of the error, while temporal locality is the outcome of the variational formulation of the problem."

    The spatial no-BP property is obtained by choosing the Lagrangian term that encodes connections in a manner that directly produces locality; the result is therefore equivalent to the modeling decision rather than an independent consequence of the least-action principle. The temporal claim is asserted without exhibiting that the Euler-Lagrange discretization avoids non-local dependencies from boundary conditions or trajectory optimization.

full rationale

The paper's core claim that STLP is local in space and time reduces to the selection of an 'appropriate' Lagrangian term that encodes connections to avoid BP, making spatial locality tautological to the modeling choice rather than derived. Temporal locality is stated as an automatic outcome of the variational setup, but the abstract supplies no explicit discrete equations or boundary-term analysis demonstrating that the resulting recurrence remains strictly local once time discretization and fixed boundaries are introduced. This matches the self-definitional pattern where the desired property is injected via the ansatz and then presented as a derived result. No self-citations or fitted predictions appear in the given text, keeping the circularity partial rather than total.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The central claim rests on the unverified premise that a variational least-action formulation can be directly applied to arbitrary digraph-based neural networks and will produce the stated locality properties; no free parameters, invented entities, or additional axioms are visible in the abstract.

axioms (1)
  • domain assumption Neural computation on digraphs can be formulated within the variational framework of the least action principle in the same manner as physical laws.
    Explicitly stated in the abstract as the starting point for the re-thinking of neural computation.

pith-pipeline@v0.9.0 · 5683 in / 1452 out tokens · 24090 ms · 2026-05-24T22:58:12.171625+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.