RECORD
Characterizing Deep Gaussian Processes via Nonlinear Recurrence Systems
Machine Learning · Submitted 19 Oct 2020
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim The recurrence relations between layers are analytically derived, providing a tighter bound and the rate of convergence of the dynamic systems.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Recent advances in Deep Gaussian Processes (DGPs) show the potential to have more expressive representation than that of traditional Gaussian Processes (GPs). However, there exists a pathology of deep Gaussian processes that their learning capacities reduce significantly when the number of layers increases. In this paper, we present a new analysis in DGPs by studying its corresponding nonlinear dynamic systems to explain the issue. Existing work reports the pathology for the squared exponential kernel function. We extend our investigation to four types of common stationary kernel functions. The recurrence relations between layers are analytically derived, providing a tighter bound and the rate of convergence of the dynamic systems. We demonstrate our finding with a number of experimental results.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Recent advances in Deep Gaussian Processes (DGPs) show the potential to have more expressive representation than that of traditional Gaussian Processes (GPs). | background 1.00 | 0.04 | 0.03 | hedged possibility 0.62 |
| s1 | However, there exists a pathology of deep Gaussian processes that their learning capacities reduce significantly when the number of layers increases. | background 0.91 | 0.09 | 0.08 | asserted 1.00 |
| s2 | In this paper, we present a new analysis in DGPs by studying its corresponding nonlinear dynamic systems to explain the issue. | contribution 0.91 | 0.89 | 0.09 | asserted 0.98 |
| s3 | Existing work reports the pathology for the squared exponential kernel function. | background 0.93 | 0.04 | 0.03 | asserted 0.99 |
| s4 | We extend our investigation to four types of common stationary kernel functions. | contribution 0.85 | 0.90 | 0.05 | asserted 0.95 |
| s5 | The recurrence relations between layers are analytically derived, providing a tighter bound and the rate of convergence of the dynamic systems. | result 0.38 | 0.96 | 0.33 | asserted 1.00 |
| s6 | We demonstrate our finding with a number of experimental results. | contribution 0.49 | 0.94 | 0.07 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v3
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Recent advances in Deep Gaussian Processes (DGPs) show the potential to have more expressive representation than that of traditional Gaussian Processes (GPs). However, there exists a pathology of deep Gaussian processes that their learning capacities reduce significantly when the number of layers increases. In this paper, we present a new analysis in DGPs by studying its corresponding nonlinear dynamic systems to explain the issue. Existing work reports the pathology for the squared exponential kernel function. We extend our investigation to four types of common stationary kernel functions. The recurrence relations between layers are analytically derived, providing a tighter bound and the rate of convergence of the dynamic systems. We demonstrate our finding with a number of experimental results.
Human review
How the literature uses it
What this paper does with the arXiv papers it cites
What it cites
Cites as background 1 paper
-
Therefore, there have been extensive studies [ref] contributing to this research area.
Nested Variational Compression in Deep Gaussian Processes · Introduction · 0.98
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.