pith. sign in

SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

In this work we introduce a new optimisation method called SAGA in the spirit of SAG, SDCA, MISO and SVRG, a set of recently proposed incremental gradient algorithms with fast linear convergence rates. SAGA improves on the theory behind SAG and SVRG, with better theoretical convergence rates, and has support for composite objectives where a proximal operator is used on the regulariser. Unlike SDCA, SAGA supports non-strongly convex problems directly, and is adaptive to any inherent strong convexity of the problem. We give experimental results showing the effectiveness of our method.

fields

cs.LG 1

years

2025 1

verdicts

UNVERDICTED 1

representative citing papers

Variance Matters: Improving Domain Adaptation via Stratified Sampling

cs.LG · 2025-12-04 · unverdicted · novelty 6.0

VaRDASS improves unsupervised domain adaptation by using stratified sampling to reduce variance in discrepancy estimation for measures like correlation alignment and MMD, with derived error bounds, an optimality proof for MMD under assumptions, and a k-means style algorithm.

citing papers explorer

Showing 1 of 1 citing paper.

  • Variance Matters: Improving Domain Adaptation via Stratified Sampling cs.LG · 2025-12-04 · unverdicted · none · ref 9 · internal anchor

    VaRDASS improves unsupervised domain adaptation by using stratified sampling to reduce variance in discrepancy estimation for measures like correlation alignment and MMD, with derived error bounds, an optimality proof for MMD under assumptions, and a k-means style algorithm.