REVIEW 2 cited by
Thermodynamic cost and benefit of memory
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
This letter exposes a tight connection between the thermodynamic efficiency of information processing and predictive inference. A generalized lower bound on dissipation is derived for partially observable information engines which are allowed to use temperature differences. It is shown that the retention of irrelevant information limits efficiency. A data representation strategy is derived from optimizing a fundamental physical limit to information processing: minimizing the lower bound on dissipation leads to a data compression method that maximally retains relevant, predictive, information. In that sense, predictive inference emerges as the strategy that least precludes energy efficiency.
Forward citations
Cited by 2 Pith papers
-
Thermodynamics of Learning: A Typed Four-Component Accounting of Memory, Fit, and Value
A typed accounting separates record correlation from operational capital value in finite learning devices, with separation, capitalization-efficiency, and value-retention theorems.
-
Pareto-optimal data compression for binary classification tasks
For binary classification, the optimal tradeoff curve between stored bits and class information is achieved by binning the posterior class probability into contiguous intervals.
Discussion (0). Continue with ORCID to comment.