REVIEW 2 cited by
Properties of Sparse Distributed Representations and their Application to Hierarchical Temporal Memory
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Empirical evidence demonstrates that every region of the neocortex represents information using sparse activity patterns. This paper examines Sparse Distributed Representations (SDRs), the primary information representation strategy in Hierarchical Temporal Memory (HTM) systems and the neocortex. We derive a number of properties that are core to scaling, robustness, and generalization. We use the theory to provide practical guidelines and illustrate the power of SDRs as the basis of HTM. Our goal is to help create a unified mathematical and practical framework for SDRs as it relates to cortical function.
Forward citations
Cited by 2 Pith papers
-
Homeostasis and Sparsity in Transformer
RFB-kWTA and Smart Inhibition, two activation-statistics-based sparsity mechanisms, are reported to improve transformer BLEU on Multi30K from 0.2768 to 0.3062, but without error bars and with best-of-grid selection.
-
Creating Intelligence: A Computational Foundation for AGI
Proposes a set-based hyperdimensional computing framework for AGI that uses subset pattern matching for associative memory and maps to brain structures.
Discussion (0). Continue with ORCID to comment.