RECORD
Neural network is heterogeneous: Phase matters more
Machine Learning · Submitted 3 Nov 2021
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim We find a heterogeneity in both complex and real valued neural networks with the insight from wave optics, claiming a much more important role of phase than its amplitude counterpart in the weight matrix.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
We find a heterogeneity in both complex and real valued neural networks with the insight from wave optics, claiming a much more important role of phase than its amplitude counterpart in the weight matrix. In complex-valued neural networks, we show that among different types of pruning, the weight matrix with only phase information preserved achieves the best accuracy, which holds robustly under various settings of depth and width. The conclusion can be generalized to real-valued neural networks, where signs take the place of phases. These inspiring findings enrich the techniques of network pruning and binary computation.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | We find a heterogeneity in both complex and real valued neural networks with the insight from wave optics, claiming a much more important role of phase than its amplitude counterpart in the weight matrix. | result 0.88 | 0.93 | 0.78 | asserted 1.00 |
| s1 | In complex-valued neural networks, we show that among different types of pruning, the weight matrix with only phase information preserved achieves the best accuracy, which holds robustly under various settings of depth and width. | result 1.00 | 0.95 | 0.45 | asserted 1.00 |
| s2 | The conclusion can be generalized to real-valued neural networks, where signs take the place of phases. | result 0.50 | 0.71 | 0.18 | asserted 0.96 |
| s3 | These inspiring findings enrich the techniques of network pruning and binary computation. | interpretation 0.95 | 0.31 | 0.04 | asserted 0.91 |
What was examined, and what was not
- arXiv listing abstract v2
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
We find a heterogeneity in both complex and real valued neural networks with the insight from wave optics, claiming a much more important role of phase than its amplitude counterpart in the weight matrix. In complex-valued neural networks, we show that among different types of pruning, the weight matrix with only phase information preserved achieves the best accuracy, which holds robustly under various settings of depth and width. The conclusion can be generalized to real-valued neural networks, where signs take the place of phases. These inspiring findings enrich the techniques of network pruning and binary computation.
Human review
References
How the literature uses it
4 arXiv papers cite this in 5 sentences
Papers citing it · 3 sentences without a confident label
Cites it as support 1 paper
-
[ref] shows that more information is stored in the phase component compared to the amplitude component in the parameter subspace, proving the heterogeneous nature of neural networks.
Fully complex-valued deep learning model for visual perception · Introduction · 1.00
Cites it as background 1 paper
-
Complex-valued data can exist in: (1) natural form, involving applications using Synthetic Aperture Radar (SAR) [ref] , Magnetic Resonance Imaging (MRI), and telecommunication, (2) complex-valued representation of real-valued data, such as Fourier transform [ref] and spectrum-based methods [ref] , and (3) physics application such as optical physics [ref] , where both amplitude and phase information are essential.
Fully complex-valued deep learning model for visual perception · Introduction · 0.85
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.