A VEST of the Pseudoinverse Learning Algorithm
read the original abstract
In this paper, we briefly review the basic scheme of the pseudoinverse learning (PIL) algorithm and present some discussions on the PIL, as well as its variants. The PIL algorithm, first presented in 1995, is a non-gradient descent and non-iterative learning algorithm for multi-layer neural networks and has several advantages compared with gradient descent based algorithms. Some new viewpoints to PIL algorithm are presented, and several common pitfalls in practical implementation of the neural network learning task are also addressed. In addition, we show that so called extreme learning machine is a Variant crEated by Simple name alTernation (VEST) of the PIL algorithm for single hidden layer feedforward neural networks.
This paper has not been read by Pith yet.
Forward citations
Cited by 2 Pith papers
-
Random Vector Functional Link Neural Network based Ensemble Deep Learning
The authors introduce dRVFL and edRVFL frameworks that stack RVFL layers with fixed random weights and closed-form outputs, reporting superior benchmark performance when combined with sparse-pretrained RVFL.
-
On improving learning capability of ELM and an application to brain-computer interface
Replacing SVD in ELM with LU, Hessenberg, Schur, Gram-Schmidt or Householder decompositions speeds training on large EEG BCI data, with Hessenberg preferred for pace and Householder for accuracy.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.