{"arxiv_id":"2611.17082","title":"Isotonic least squares is robust to heteroscedasticity, unimodal least squares is not","abstract":"We compare the least squares estimator (LSE) with the $\\ell_{1}$-estimator recently introduced by Baraud and Maillard~\\citeyearpar{BM-2026} for estimating a regression function under a fixed design, when the errors are independent but possibly heteroscedastic and heavy-tailed. We show that the two estimators coincide on the class of nondecreasing (or nonincreasing) functions on an interval. As a consequence, the isotonic LSE inherits the non-asymptotic $\\ell_{1}$-risk bounds of the $\\ell_{1}$-estimator, which only require a moment of order $p\\in[1,2]$ on the errors and depend on the average of their $p$-th absolute moments rather than on their maximum. This coincidence no longer holds on the nonconvex class of unimodal functions: we exhibit a heteroscedastic Gaussian example in which the LSE is inconsistent while the $\\ell_{1}$-estimator converges at the parametric rate. Finally, we show on a one-dimensional linear model that neither estimator dominates the other: depending on the way the noise is distributed among the design points, the LSE may converge at rate $1/n$ while the $\\ell_{1}$-estimator is inconsistent.","primary_cat":"math.ST","cross_cats":["stat.TH"],"submitted_at":"2026-11-12T16:49:59+00:00","latest_version":1,"source":"arxiv","source_label":"arXiv","source_url":null,"has_pdf":true,"has_source":false,"verdict":"CONDITIONAL","confidence":"MODERATE","one_line_summary":"Isotonic least squares is equivalent to a robust ℓ1 estimator and thus inherits its risk bounds, but this equivalence fails for unimodal regression where least squares can be inconsistent under heteroscedastic noise.","novelty_score":7.0,"correctness_risk":"medium","formal_verification":"none","upvotes":0,"downvotes":0,"pith_score":0,"inbound_count":0,"_links":{"html":"https://pith.science/paper/2611.17082","verdict":"/api/v1/verdicts/2611.17082"}}