LALR: Theoretical and Experimental validation of Lipschitz Adaptive Learning Rate in Regression and Neural Networks

Snehanshu Saha; Soma S Dhavala; Sumedh Basarkod; Suraj Aralihalli; Tejas Prashanth; T.S.B Sudarshan

LALR: Theoretical and Experimental validation of Lipschitz Adaptive Learning Rate in Regression and Neural Networks

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2006.13307 v1 pith:WVXMJFB6 submitted 2020-05-19 cs.LG stat.ML

LALR: Theoretical and Experimental validation of Lipschitz Adaptive Learning Rate in Regression and Neural Networks

Snehanshu Saha , Tejas Prashanth , Suraj Aralihalli , Sumedh Basarkod , T.S.B Sudarshan , Soma S Dhavala This is my paper

classification cs.LG stat.ML

keywords learningrateadaptivefunctionlipschitzlosspolicyconstant

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

0 comments

read the original abstract

We propose a theoretical framework for an adaptive learning rate policy for the Mean Absolute Error loss function and Quantile loss function and evaluate its effectiveness for regression tasks. The framework is based on the theory of Lipschitz continuity, specifically utilizing the relationship between learning rate and Lipschitz constant of the loss function. Based on experimentation, we have found that the adaptive learning rate policy enables up to 20x faster convergence compared to a constant learning rate policy.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

HypEMBER: Hypernetwork-based Ensemble for Robust Policy Learning of Parametrized Dynamical Systems
cs.LG 2026-07 conditional novelty 5.0

HypEMBER joins hypernetwork-generated policies with an ensemble critic to improve robustness of reinforcement-learning controllers for parametrized dynamical systems.