Presents an active-sampling method that approximates the weight subspace from Hessian finite differences, recovers the rank-1 tensors by robust nonlinear programming, and attributes layers with gradient descent, yielding stable recovery under a-posteriori verifiable conditions.
E., Carroll, R
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
abstract
In this paper, we provide local and global convergence guarantees for recovering CP (Candecomp/Parafac) tensor decomposition. The main step of the proposed algorithm is a simple alternating rank-$1$ update which is the alternating version of the tensor power iteration adapted for asymmetric tensors. Local convergence guarantees are established for third order tensors of rank $k$ in $d$ dimensions, when $k=o \bigl( d^{1.5} \bigr)$ and the tensor components are incoherent. Thus, we can recover overcomplete tensor decomposition. We also strengthen the results to global convergence guarantees under stricter rank condition $k \le \beta d$ (for arbitrary constant $\beta > 1$) through a simple initialization procedure where the algorithm is initialized by top singular vectors of random tensor slices. Furthermore, the approximate local convergence guarantees for $p$-th order tensors are also provided under rank condition $k=o \bigl( d^{p/2} \bigr)$. The guarantees also include tight perturbation analysis given noisy tensor.
verdicts
UNVERDICTED 2representative citing papers
A novel kernel-weighted sparse reduced-rank regression framework is proposed to model collective effects of neighboring cell transcriptomics on plaque size for spatial transcriptomics data in Alzheimer disease studies.
citing papers explorer
-
Robust and Resource Efficient Identification of Two Hidden Layer Neural Networks
Presents an active-sampling method that approximates the weight subspace from Hessian finite differences, recovers the rank-1 tensors by robust nonlinear programming, and attributes layers with gradient descent, yielding stable recovery under a-posteriori verifiable conditions.
-
Sparse Reduced-rank Regression Methods for Spatially Misaligned Data with Application to Spatial Transcriptomics
A novel kernel-weighted sparse reduced-rank regression framework is proposed to model collective effects of neighboring cell transcriptomics on plaque size for spatial transcriptomics data in Alzheimer disease studies.