Pith. sign in

REVIEW 1 major objections 2 minor 59 references

Relax and Follow: L0-Path Computation with L0-Bregman Relaxations

T0 review · 1 major / 2 minor · reviewed 2026-06-28 · grok-4.3

Pith's one-line read L0PathBrex computes L0 solution paths by relaxing the objective with Bregman functions that preserve global minimizers and support warm-start tracking.

desk verdict L0PathBrex turns B-rex relaxations into a warm-start path algorithm that outperforms baselines on sparse regression tasks. read the letter →

arxiv 2606.02176 v1 pith:LNA2TU75 submitted 2026-06-01 math.OC

classification math.OC
keywords L0regularizationsolutionpathBregmanrelaxationsparseregressionwarm-startleastsquareslogistic
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper presents L0PathBrex as a method to estimate the solution path of L0-regularized problems. It relies on L0-Bregman relaxations that reformulate the discrete L0 penalty as a continuous objective while keeping the original global minimizers. These relaxations remove some unwanted local minima, so standard numerical solvers can be applied. The method uses warm starts to generate candidate minimizers and determines the intervals of the regularization parameter where each candidate stays valid. Experiments on sparse least-squares and logistic regression show better performance than existing approaches on both synthetic and real data.

What carries the argument

L0 Bregman relaxations (B-rex): continuous reformulations of the L0 objective that preserve global minimizers while eliminating part of the undesirable local minima.

What would settle it

A sparse least-squares instance where the true global L0 minimizer for some regularization value is never recovered as a local minimizer of any B-rex relaxation would show the method misses solutions.

Watch

Extended reading notes

Core claim

L0PathBrex dynamically constructs a collection of local minimizers that are candidates for the L0-solution path. It does so by solving L0 Bregman relaxations with any numerical solver, exploiting warm-start strategies, and identifying ranges of the regularization parameter for which each minimizer remains valid under the corresponding relaxation.

Load-bearing premise

L0 Bregman relaxations preserve the global minimizers of the original L0 problem and allow warm-start strategies to trace valid candidates across regularization values.

Editorial extensions

If this is right

  • The method applies directly to non-quadratic data-fidelity terms such as logistic or Poisson regression.
  • Any off-the-shelf numerical solver for the relaxed problem can generate the path.
  • The approach identifies explicit intervals of the regularization parameter on which each local minimizer remains valid.
  • Systematic gains over state-of-the-art baselines appear on both synthetic and real-world sparse regression tasks.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same relaxation-plus-warm-start pattern could be tested on other combinatorial penalties such as group sparsity or rank constraints.
  • Because the method re-uses existing solvers, it may enable path computation on problem sizes where branch-and-bound or combinatorial search becomes prohibitive.
  • Different choices of the B-rex family could be compared systematically on Poisson regression to see which family yields the most accurate paths.
  • The identified validity intervals for each minimizer might support adaptive selection of the regularization parameter without exhaustive grid search.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

1 major / 2 minor

Summary. The paper introduces L0PathBrex, a method for estimating the solution path of L0-regularized problems via L0-Bregman relaxations (B-rex). These provide continuous reformulations applicable to non-quadratic fidelity terms that preserve global minimizers while removing some undesirable local minima. Given any numerical solver, the approach dynamically constructs candidate local minimizers for the L0 path using warm-starts and identifies valid regularization-parameter ranges. Experiments on sparse least-squares, logistic regression, and Poisson regression tasks show systematic outperformance over state-of-the-art baselines on synthetic and real-world datasets, with additional analysis of B-rex choice in the Poisson setting.

Significance. If the empirical outperformance holds under rigorous validation, the work offers a practical extension of prior B-rex literature to L0 path computation for non-quadratic losses, potentially improving efficiency and solution quality in sparse regression. The dynamic warm-start construction and sensitivity analysis to B-rex functions add concrete value for applied optimization.

major comments (1)
  1. [Experiments] Experiments section: the central claim of systematic outperformance (abstract and §4) asserts superiority across metrics and datasets but provides no details on error bars, statistical significance tests, data exclusion rules, or the precise implementation of the dynamic construction and warm-start strategy. This is load-bearing for the empirical contribution and prevents assessment of robustness.
minor comments (2)
  1. Abstract: the phrase 'various evaluation metrics' is vague; explicitly naming the primary metrics (e.g., support recovery, prediction error) would improve clarity.
  2. Notation: ensure consistent use of the B-rex family parameters across sections describing the relaxation and the path-construction algorithm.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for the constructive comment regarding the Experiments section. We will revise the manuscript to address the lack of implementation and statistical details.

read point-by-point responses
  1. Referee: [Experiments] Experiments section: the central claim of systematic outperformance (abstract and §4) asserts superiority across metrics and datasets but provides no details on error bars, statistical significance tests, data exclusion rules, or the precise implementation of the dynamic construction and warm-start strategy. This is load-bearing for the empirical contribution and prevents assessment of robustness.

    Authors: We agree that these details are necessary for assessing robustness. In the revised manuscript we will: (i) report error bars computed from 10–20 independent runs with different random seeds for all synthetic and real-world experiments; (ii) add statistical significance tests (paired t-tests or Wilcoxon signed-rank tests with p-values) comparing L0PathBrex against each baseline on the primary metrics; (iii) explicitly state that no data points were excluded beyond standard preprocessing steps described in §4; and (iv) include a new subsection (or appendix) with pseudocode and parameter settings that fully specify the dynamic local-minimizer construction, warm-start procedure, and range-identification logic. These additions will be placed in §4 and will not alter any numerical results. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity detected

full rationale

The paper's central contribution is the L0PathBrex algorithm for constructing candidate L0-solution paths via warm-started numerical solves on B-rex relaxations. The key properties (preservation of global minimizers, removal of some local minima) are explicitly attributed to 'recently introduced and analyzed' prior literature rather than derived or fitted inside this manuscript. No equations reduce a claimed prediction to a fitted parameter by construction, no uniqueness theorem is imported from the same authors' prior work to force the method, and the experimental outperformance claims rest on new comparisons rather than self-referential renaming or ansatz smuggling. The derivation chain is therefore self-contained against external benchmarks.

Assumptions & free parameters 0 free parameters · 1 assumptions · 0 invented entities

The central claim rests on properties of L0-Bregman relaxations from prior work and the assumption that warm-start strategies can track validity ranges; no new free parameters or invented entities are introduced in the abstract.

assumptions (1)
  • domain assumption L0 Bregman relaxations preserve global minimizers while eliminating undesirable local minima
    Invoked in the abstract as the key property enabling the continuous reformulation and dynamic construction approach.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Relax and Follow: L0-Path Computation with L0-Bregman Relaxations." pith.science (2026). https://pith.science/paper/LNA2TU75

@misc{pith2026260602176,
  author       = {Pith},
  title        = {Pith review of: Relax and Follow: L0-Path Computation with L0-Bregman Relaxations},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LNA2TU75}},
  note         = {Machine review of arXiv:2606.02176}
}
read the original abstract

This work introduces L0PathBrex, a novel method for estimating the solution path of L0-regularized problems through the use of L0 Bregman relaxations (B-rex). Recently introduced and analyzed in the literature, these relaxations provide continuous reformulations of the original objective, are applicable to possibly non-quadratic data fidelity terms, and depend on a family of functions designed to preserve the global minimizers while eliminating part of the undesirable local minima. Given any numerical solver for the relaxation, the proposed approach dynamically constructs a collection of local minimizers that are candidates for the L0-solution path. It exploits warm-start strategies and identifies ranges of the regularization parameter for which each minimizer remains valid under the corresponding relaxation. Experiments on sparse least-squares and logistic regression problems demonstrate that L0PathBrex systematically outperforms state-of-the-art baselines across both synthetic and real-world datasets in terms of various evaluation metrics; additionally, the study investigates how the choice of the B-rex affects the quality of the estimated path in the sparse Poisson regression setting.

Figures

Figures reproduced from arXiv: 2606.02176 by the authors.

Figure 1
Figure 1. The ℓ0-curve. Plot of the affine functions λ0 7→ (Fy(Axˆ) + λ2 2 ∥xˆ∥ 2 ) + λ0∥xˆ∥0 for all fifteen (strict local) minimizers xˆ of a ℓ0-regularized least-squares problem (Fy(A·) = 1 2 ∥A·−y∥ 2 , λ2 = 0) of size (M, N) = (3, 4). The ℓ0-curve corresponds to the lower concave envelope of these affine functions, and is represented by the solid line. It is piecewise linear, with breakpoints (λˆ1 0 , λˆ2 0 , λˆ3 0 ) that… view at source ↗
Figure 2
Figure 2. The ℓ0-curve computed using B-rex. Plots of the segments corresponding to strict local minimizers of J0 preserved by the exact relaxation JΨ. Each segment is supported on an interval [λ0 (xˆ), λ¯ 0(xˆ)] given by Theorem 2. This graph is the counterpart of [PITH_FULL_IMAGE:figures/full_fig_p008_2.png] view at source ↗
Figure 3
Figure 3. L0PathBrex-A applied to the ℓ0-regularized least-squares problem illustrated in Fig￾ures 1 and 2. Here, a single forward and backward pass is performed (Npass = 1), with k max = 3 and ρ = 0.98. Each subplot corresponds to a step of the algorithm. In the four top plots, solid colored segments represent the current points in X , while the purple cross marks the initially selected point x0 at λ0 = ρλ0 (x0) for the forw… view at source ↗
Figures from the paper (10 more)
Figure 4
Figure 4. Figure 4: LS. Average F1-score (top) and RMSE (bottom) as functions of the number of sam [PITH_FULL_IMAGE:figures/full_fig_p017_4.png]
Figure 5
Figure 5. Figure 5: LS. Same as Figure [PITH_FULL_IMAGE:figures/full_fig_p018_5.png]
Figure 6
Figure 6. Figure 6: Estimated Pareto fronts for the LS problem on the four real datasets from Table [PITH_FULL_IMAGE:figures/full_fig_p019_6.png]
Figure 7
Figure 7. Figure 7: LR. Average F1-score (top) and RMSE (bottom) as functions of the number of samples, [PITH_FULL_IMAGE:figures/full_fig_p020_7.png]
Figure 8
Figure 8. Figure 8: LR. Same as in Figure [PITH_FULL_IMAGE:figures/full_fig_p021_8.png]
Figure 9
Figure 9. Figure 9: Estimated Pareto fronts for the LR problem on the two real datasets from Table [PITH_FULL_IMAGE:figures/full_fig_p022_9.png]
Figure 10
Figure 10. Figure 10: Same as Figure [PITH_FULL_IMAGE:figures/full_fig_p025_10.png]
Figure 11
Figure 11. Figure 11: Same as Figure [PITH_FULL_IMAGE:figures/full_fig_p026_11.png]
Figure 12
Figure 12. Figure 12: Same as Figure [PITH_FULL_IMAGE:figures/full_fig_p026_12.png]
Figure 13
Figure 13. Figure 13: Same as Figure [PITH_FULL_IMAGE:figures/full_fig_p027_13.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

59 extracted references · 4 canonical work pages

  1. [1]

    Notterman, Kenneth W

    Uri Alon, Naama Barkai, Daniel A. Notterman, Kenneth W. Gish, Suzanne E. Ybarra, Douglas Michael Mach, and Arnold J. Levine. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proceedings of the National Academy of Sciences of the United States of America, 96 12: 6745–50, 1999

  2. [2]

    HédyAttouch, JérômeBolte, PatrickRedont, andAntoineSoubeyran. Proximalalternating minimization and projection methods for nonconvex problems: An approach based on the kurdyka-łojasiewicz inequality.Mathematics of Operations Research, 35(2):438–457, 2010

  3. [3]

    A fast iterative shrinkage-thresholding algorithm for linear inverse problems.SIAM journal on imaging sciences, 2(1):183–202, 2009

    Amir Beck and Marc Teboulle. A fast iterative shrinkage-thresholding algorithm for linear inverse problems.SIAM journal on imaging sciences, 2(1):183–202, 2009

  4. [4]

    Beyond l1: Faster and better sparse models with skglm

    Quentin Bertrand, Quentin Klopfenstein, Pierre-Antoine Bannier, Gauthier Gidel, and Mathurin Massias. Beyond l1: Faster and better sparse models with skglm. InNeurIPS, 2022. 24 0 5 10 15 20 25 300 2 4 6 8Fy(Ax) RIBOFLAVIN L0Learn L0PD L0PathBrex-skglm L0PathBrex-FBS L0PathBrex-IRL1 0 5 10 15 20 25 300 200 400 600 NCI-60 0 5 10 15 20 25 300 5 10 15 ∥x∥0 Fy...

  5. [5]

    Best subset selection via a modern optimization lens.The Annals of Statistics, 44(2):813, 2016

    Dimitris Bertsimas, Angela King, and Rahul Mazumder. Best subset selection via a modern optimization lens.The Annals of Statistics, 44(2):813, 2016

  6. [6]

    A smoothing proximal gradient algorithm for nonsmooth convex regression with cardinality penalty.SIAM Journal on Numerical Analysis, 58(1): 858–883, 2020

    Wei Bian and Xiaojun Chen. A smoothing proximal gradient algorithm for nonsmooth convex regression with cardinality penalty.SIAM Journal on Numerical Analysis, 58(1): 858–883, 2020. ISSN 1095-7170

  7. [7]

    Exact sparse approximation problems via mixed-integer programming: Formulations and computational performance.IEEE Transactions on Signal Processing, 64(6):1405–1419, 2016

    Sébastien Bourguignon, Jordan Ninin, Hervé Carfantan, and Marcel Mongeau. Exact sparse approximation problems via mixed-integer programming: Formulations and computational performance.IEEE Transactions on Signal Processing, 64(6):1405–1419, 2016

  8. [8]

    L.M. Bregman. The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming.USSR Computational Mathematics and Mathematical Physics, 7(3):200–217, 1967

Show all 59 references
  1. [9]

    Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection.Annals of Applied Statistics, 5 (1):232–253, 2011

    Patrick Breheny and Jian Huang. Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection.Annals of Applied Statistics, 5 (1):232–253, 2011

  2. [10]

    High-dimensional statistics with a view toward applications in biology.Annual Review of Statistics and Its Application, 1:255–278, 01 2014

    Peter Bühlmann, Markus Kalisch, and Lukas Meier. High-dimensional statistics with a view toward applications in biology.Annual Review of Statistics and Its Application, 1:255–278, 01 2014. doi: 10.1146/annurev-statistics-022513-115545

  3. [11]

    Candes, J

    E.J. Candes, J. Romberg, and T. Tao. Robust uncertainty principles: exact signal recon- struction from highly incomplete frequency information.IEEE Transactions on Information Theory, 52(2):489–509, 2006. 25 0 5 10 15 20 25 300 2 4 6 8Fy(Ax) RIBOFLAVIN L0Learn L0PD L0PathBrex-...

  4. [12]

    Candès, Michael B

    Emmanuel J. Candès, Michael B. Wakin, and Stephen P. Boyd. Enhancing sparsity by reweightedℓ 1 minimization.Journal of Fourier Analysis and Applications, 14:877–905, 2007

  5. [13]

    On convex envelopes and regularization of non-convex functionals without moving global minima.Journal of Optimization Theory and Applications, 183(1):66–84, 2019

    Marcus Carlsson. On convex envelopes and regularization of non-convex functionals without moving global minima.Journal of Optimization Theory and Applications, 183(1):66–84, 2019. 26 0 5 10 15 20 25 300 0.1 0.2 ∥x∥0 Fy(Ax) + λ2 2∥x∥2 COLON-CANCER L0Learn L0PathBrex-skglm L0Pat...

  6. [14]

    An unbiased approach to compressed sensing.Inverse Problems, 36(11):115014, 2020

    Marcus Carlsson, Daniele Gerosa, and Carl Olsson. An unbiased approach to compressed sensing.Inverse Problems, 36(11):115014, 2020

  7. [15]

    Spoqℓp- over-ℓq regularization for sparse signal recovery applied to mass spectrometry.IEEE Trans- actions on Signal Processing, 68:6070–6084, 2020

    Afef Cherni, Emilie Chouzenoux, Laurent Duval, and Jean-Christophe Pesquet. Spoqℓp- over-ℓq regularization for sparse signal recovery applied to mass spectrometry.IEEE Trans- actions on Signal Processing, 68:6070–6084, 2020

  8. [16]

    Optimization land- scape of l0-bregman relaxations.arXiv preprint arXiv:2511.12157, 2025

    Jonathan Chirinos-Rodriguez, Cédric Févotte, and Emmanuel Soubies. Optimization land- scape of l0-bregman relaxations.arXiv preprint arXiv:2511.12157, 2025

  9. [17]

    A block coordinate variable metric forward–backward algorithm.Journal of Global Optimization, 66(3):457– 485, 2016

    Emilie Chouzenoux, Jean-Christophe Pesquet, and Audrey Repetti. A block coordinate variable metric forward–backward algorithm.Journal of Global Optimization, 66(3):457– 485, 2016

  10. [18]

    Proximal splitting methods in signal processing

    Patrick L Combettes and Jean-Christophe Pesquet. Proximal splitting methods in signal processing. InFixed-point algorithms for inverse problems in science and engineering, pages 185–212. Springer, 2011

  11. [19]

    Learning sparse classifiers: Con- tinuous and mixed integer optimization perspectives.Journal of Machine Learning Re- search, 2021

    Antoine Dedieu, Hussein Hazimeh, and Rahul Mazumder. Learning sparse classifiers: Con- tinuous and mixed integer optimization perspectives.Journal of Machine Learning Re- search, 2021

  12. [20]

    Anovelintegerlinearprogramming approach for globalℓ0 minimization.Journal of Machine Learning Research, 24(382):1–28, 2023

    DiegoDelleDonne, MatthieuKowalski, andLeoLiberti. Anovelintegerlinearprogramming approach for globalℓ0 minimization.Journal of Machine Learning Research, 24(382):1–28, 2023

  13. [21]

    Least angle regres- sion.The Annals of statistics, 32(2):407–451, 2004

    Bradley Efron, Trevor Hastie, Iain Johnstone, and Robert Tibshirani. Least angle regres- sion.The Annals of statistics, 32(2):407–451, 2004

  14. [22]

    Essafri, L

    M. Essafri, L. Calatroni, and E. Soubies. Exact continuous relaxations ofℓ0-regularized criteria with non-quadratic data terms.Journal of Global Optimization, 2025

  15. [23]

    Onℓ0-bregman-relaxations for kullback-leibler sparse regression

    Mhamed Essafri, Luca Calatroni, and Emmanuel Soubies. Onℓ0-bregman-relaxations for kullback-leibler sparse regression. InIEEE International Workshop on Machine Learning for Signal Processing, pages 1–6, 2024

  16. [24]

    Variable selection via nonconcave penalized likelihood and its oracle properties.Journal of the American Statistical Association, 96:1348 – 1360, 2001

    Jianqing Fan and Runze Li. Variable selection via nonconcave penalized likelihood and its oracle properties.Journal of the American Statistical Association, 96:1348 – 1360, 2001. 27

  17. [25]

    A paraboloidal surrogates algorithm for convergent penalized-likelihood emission image reconstruction

    Jeffrey A Fessler and Hakan Erdogan. A paraboloidal surrogates algorithm for convergent penalized-likelihood emission image reconstruction. In1998 IEEE Nuclear Science Sym- posium Conference Record. 1998 IEEE Nuclear Science Symposium and Medical Imaging Conference (Cat. No. 9...

  18. [26]

    Sparsest solutions of underdetermined linear systems via ℓq-minimization for0< q≤1.Applied and Computational Harmonic Analysis, 26:395–407, 2009

    Simon Foucart and Ming-Jun Lai. Sparsest solutions of underdetermined linear systems via ℓq-minimization for0< q≤1.Applied and Computational Harmonic Analysis, 26:395–407, 2009

  19. [27]

    Perspective cuts for a class of convex 0–1 mixed integer programs.Mathematical Programming, 106:225–236, 2006

    Antonio Frangioni and Claudio Gentile. Perspective cuts for a class of convex 0–1 mixed integer programs.Mathematical Programming, 106:225–236, 2006

  20. [28]

    Pathwise coordi- nate optimization.The Annals of Applied Statistics, 1(2):302–332, 2007

    Jerome Friedman, Trevor Hastie, Holger Höfling, and Robert Tibshirani. Pathwise coordi- nate optimization.The Annals of Applied Statistics, 1(2):302–332, 2007

  21. [29]

    Regularization paths for gen- eralized linear models via coordinate descent.Journal of Statistical Software, 33(1):1–22, 2010

    Jerome Friedman, Trevor Hastie, and Robert Tibshirani. Regularization paths for gen- eralized linear models via coordinate descent.Journal of Statistical Software, 33(1):1–22, 2010

  22. [30]

    Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.science, 286(5439):531–537, 1999

    Todd R Golub, Donna K Slonim, Pablo Tamayo, Christine Huard, Michelle Gaasenbeek, Jill P Mesirov, Hilary Coller, Mignon L Loh, James R Downing, Mark A Caligiuri, et al. Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.scien...

  23. [31]

    Perspective reformulations of mixed integer nonlinear programs with indicator variables.Mathematical programming, 124:183–205, 2010

    Oktay Günlük and Jeff Linderoth. Perspective reformulations of mixed integer nonlinear programs with indicator variables.Mathematical programming, 124:183–205, 2010

  24. [32]

    A new branch-and- bound pruning framework for l0-regularized problems

    Théo Guyard, Cédric Herzet, Clément Elvira, and Ayse-Nur Arslan. A new branch-and- bound pruning framework for l0-regularized problems. InInternational Conference on Ma- chine Learning (ICML). PMLR, 2024

  25. [33]

    El0ps: An exact l0-regularized problems solver.arXiv preprint arXiv:2506.06373, 2025

    Théo Guyard, Cédric Herzet, and Clément Elvira. El0ps: An exact l0-regularized problems solver.arXiv preprint arXiv:2506.06373, 2025

  26. [34]

    Fast best subset selection: Coordinate descent and local combinatorial optimization algorithms.Operations Research, 68(5):1517–1537, 2020

    Hussein Hazimeh and Rahul Mazumder. Fast best subset selection: Coordinate descent and local combinatorial optimization algorithms.Operations Research, 68(5):1517–1537, 2020

  27. [35]

    L0learn: A scalable package for sparse learning using l0 regularization.Journal of Machine Learning Research, 24(205):1–8, 2023

    Hussein Hazimeh, Rahul Mazumder, and Tim Nonet. L0learn: A scalable package for sparse learning using l0 regularization.Journal of Machine Learning Research, 24(205):1–8, 2023

  28. [36]

    Dc approximation approaches for sparse optimization.European Journal of Operational Research, 244(1): 26–46, 2015

    Hoai An Le Thi, T Pham Dinh, Hoai Minh Le, and Xuan Thanh Vo. Dc approximation approaches for sparse optimization.European Journal of Operational Research, 244(1): 26–46, 2015

  29. [37]

    Mallat and Zhifeng Zhang

    S.G. Mallat and Zhifeng Zhang. Matching pursuits with time-frequency dictionaries.IEEE Transactions on Signal Processing, 41(12):3397–3415, Dec 1993. ISSN 1941-0476

  30. [38]

    L Mangasarian

    O. L Mangasarian. Machine learning via polyhedral concave minimization. InApplied Mathematics and Parallel Computing: Festschrift for Klaus Ritter, pages 175–188. 1996

  31. [39]

    Sparsenet: Coordinate descent with nonconvex penalties.Journal of the American Statistical Association, 106:1125–1138, 01 2010

    Rahul Mazumder, Jerome Friedman, and Trevor Hastie. Sparsenet: Coordinate descent with nonconvex penalties.Journal of the American Statistical Association, 106:1125–1138, 01 2010. doi: 10.1198/jasa.2011.tm09738

  32. [40]

    A fast approach for overcomplete sparse decomposition based on smoothedℓ 0 norm.IEEE Transactions on Signal Processing, 57:289–301, 2008

    Hossein Mohimani, Massoud Babaie-zadeh, and Christian Jutten. A fast approach for overcomplete sparse decomposition based on smoothedℓ 0 norm.IEEE Transactions on Signal Processing, 57:289–301, 2008. 28

  33. [41]

    Natarajan

    Balas K. Natarajan. Sparse approximate solutions to linear systems.SIAM Journal on Computing., 24:227–234, 1995

  34. [42]

    Gradient methods for minimizing composite functions.Mathematical pro- gramming, 140(1):125–161, 2013

    Yu Nesterov. Gradient methods for minimizing composite functions.Mathematical pro- gramming, 140(1):125–161, 2013

  35. [43]

    Nguyen, Charles Soussen, Jérôme Idier, and El-Hadi Djermoune

    Thanh T. Nguyen, Charles Soussen, Jérôme Idier, and El-Hadi Djermoune. Np-hardness ofℓ 0 minimization problems: revision and extension to the non-negative setting. InIEEE International Conference on Sampling Theory and Applications, pages 1–4, 2019

  36. [44]

    Description of the minimizers of least squares regularized withℓ0-norm

    Mila Nikolova. Description of the minimizers of least squares regularized withℓ0-norm. Uniqueness of the global minimizer.SIAM Journal on Imaging Sciences, 6(2):904–937, 2013

  37. [45]

    On iteratively reweighted algorithms for nonsmooth nonconvex optimization in computer vision.SIAM Journal on Imaging Sciences, 8(3):331–372, 2015

    Peter Ochs, Alexey Dosovitskiy, Thomas Brox, and Thomas Pock. On iteratively reweighted algorithms for nonsmooth nonconvex optimization in computer vision.SIAM Journal on Imaging Sciences, 8(3):331–372, 2015

  38. [46]

    Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition

    Yagyensh Chandra Pati, Ramin Rezaiifar, and PS Krishnaprasad. Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition. In Proceedings of the 27th Asilomar Conference on Signals, Systems, and Computers, volume1, pages 40–44, 1993

  39. [47]

    Pilanci, M.J

    M. Pilanci, M.J. Wainwright, and L. El Ghaoui. Sparse learning via boolean relaxations. Mathematical Programming, 151(1):63–87, 2015. ISSN 0025-5610

  40. [48]

    Euclid in a taxicab: Sparse blind deconvolution with smoothedℓ1/ℓ2 regularization.IEEE Signal Processing Letters, 22(5):539–543, 2015

    Audrey Repetti, Mai Quyen Pham, Laurent Duval, Emilie Chouzenoux, and Jean- Christophe Pesquet. Euclid in a taxicab: Sparse blind deconvolution with smoothedℓ1/ℓ2 regularization.IEEE Signal Processing Letters, 22(5):539–543, 2015

  41. [49]

    Systematic variation in gene expression patterns in human cancer cell lines.Nature genetics, 24(3):227–235, 2000

    Douglas T Ross, Uwe Scherf, Michael B Eisen, Charles M Perou, Christian Rees, Paul Spellman, Vishwanath Iyer, Stefanie S Jeffrey, Matt Van de Rijn, Mark Waltham, et al. Systematic variation in gene expression patterns in human cancer cell lines.Nature genetics, 24(3):227–235, 2000

  42. [50]

    Piecewise linear regularized solution paths.The Annals of Statistics, 35(3):1012–1030, 2007

    Saharon Rosset and Ji Zhu. Piecewise linear regularized solution paths.The Annals of Statistics, 35(3):1012–1030, 2007

  43. [51]

    A continuous exactℓ0 penalty (CEL0) for least squares regularized problem.SIAM Journal on Imaging Sciences, 8(3): 1607–1639, 2015

    Emmanuel Soubies, Laure Blanc-Féraud, and Gilles Aubert. A continuous exactℓ0 penalty (CEL0) for least squares regularized problem.SIAM Journal on Imaging Sciences, 8(3): 1607–1639, 2015

  44. [52]

    A unified view of exact con- tinuous penalties forℓ2-ℓ0 minimization.SIAM Journal on Optimization, 27(3):2034–2060, 2017

    Emmanuel Soubies, Laure Blanc-Féraud, and Gilles Aubert. A unified view of exact con- tinuous penalties forℓ2-ℓ0 minimization.SIAM Journal on Optimization, 27(3):2034–2060, 2017

  45. [53]

    From bernoulli–gaussian deconvolution to sparse signal restoration.IEEE Transactions on Signal Processing, 59 (10):4572–4584, 2011

    Charles Soussen, Jérôme Idier, David Brie, and Junbo Duan. From bernoulli–gaussian deconvolution to sparse signal restoration.IEEE Transactions on Signal Processing, 59 (10):4572–4584, 2011

  46. [54]

    Charles Soussen, Jérôme Idier, Junbo Duan, and David Brie.ℓ 2-ℓ0 regularization path tracking algorithms. 01 2014

  47. [55]

    Regression shrinkage and selection via the LASSO.Journal of the Royal Statistical Society, 58(1):267–288, 1996

    Robert Tibshirani. Regression shrinkage and selection via the LASSO.Journal of the Royal Statistical Society, 58(1):267–288, 1996. 29

  48. [56]

    Cardinality minimization, constraints, and regularization: a survey.SIAM Review, 66(3):403–477, 2024

    Andreas M Tillmann, Daniel Bienstock, Andrea Lodi, and Alexandra Schwartz. Cardinality minimization, constraints, and regularization: a survey.SIAM Review, 66(3):403–477, 2024

  49. [57]

    L. Wei, A. Gómez, and S. Küçükyavuz. Ideal formulations for constrained convex optimiza- tion problems with indicator variables.Mathematical Programming, 192(1):57–88, 2022

  50. [58]

    Nearly unbiased variable selection under minimax concave penalty.The Annals of Statistics, 38(2):894 – 942, 2010

    Cun-Hui Zhang. Nearly unbiased variable selection under minimax concave penalty.The Annals of Statistics, 38(2):894 – 942, 2010

  51. [59]

    Multi-stage convex relaxation for learning with sparse regularization

    Tong Zhang. Multi-stage convex relaxation for learning with sparse regularization. In Advances in Neural Information Processing Systems, volume 21, 2008. 30

Pith tools

Reviewed June 28, 2026 · model on record in the stance chip above.