REVIEW 14 cited by
Tensor Networks Meet Neural Networks: A Survey and Future Perspectives
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Tensor Networks Meet Neural Networks: A Survey and Future Perspectives
read the original abstract
Tensor networks (TNs) and neural networks (NNs) are two fundamental data modeling approaches. TNs were introduced to solve the curse of dimensionality in large-scale tensors by converting an exponential number of dimensions to polynomial complexity. As a result, they have attracted significant attention in the fields of quantum physics and machine learning. Meanwhile, NNs have displayed exceptional performance in various applications, e.g., computer vision, natural language processing, and robotics research. Interestingly, although these two types of networks originate from different observations, they are inherently linked through the typical multilinearity structure underlying both TNs and NNs, thereby motivating a significant number of developments regarding combinations of TNs and NNs. In this paper, we refer to these combinations as tensorial neural networks~(TNNs) and present an introduction to TNNs from both data processing and model architecture perspectives. From the data perspective, we explore the capabilities of TNNs in multi-source fusion, multimodal pooling, data compression, multi-task training, and quantum data processing. From the model perspective, we examine TNNs' integration with various architectures, including Convolutional Neural Networks, Recurrent Neural Networks, Graph Neural Networks, Transformers, Large Language Models, and Quantum Neural Networks. Furthermore, this survey also explores methods for improving TNNs, examines flexible toolboxes for implementing TNNs, and documents TNN development while highlighting potential future directions. To the best of our knowledge, this is the first comprehensive survey that bridges the connections among NNs and TNs. We provide a curated list of TNNs at https://github.com/tnbar/awesome-tensorial-neural-networks.
Forward citations
Cited by 14 Pith papers
-
A fast sum-of-Gaussians algorithm for the high-dimensional fractional Fokker-Planck equation
A sum-of-Gaussians approximation to the Fourier multiplier of the FFPE fundamental solution yields an O(M d N) separated representation that works in dimensions up to 10^5 with logarithmic growth in M for fixed accuracy.
-
Classical Neural Networks on Quantum Devices via Tensor Network Disentanglers: A Case Study in Image Classification
A hybrid classical-quantum scheme compresses and disentangles bottleneck layers of pre-trained neural networks into MPO form for execution on quantum devices, validated via proof-of-concept on MNIST and CIFAR-10 image...
-
Derivation of Runge--Kutta Order Conditions via Functional Tree Tensor Networks
A functional tree tensor network framework derives Runge-Kutta order conditions by direct comparison of tensor-structured Taylor expansions for exact and numerical solutions.
-
Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) for Exponential Parameter Compression of Deep Neural Networks
ADNTNs compress DNN weights by 2000x-77000x per layer on AlexNet and VGG-16 using nonlinear tensor network cores trained with reverse-mode AD, often matching or exceeding baseline accuracy.
-
T-GINEE: A Tensor-Based Multilayer Graph Representation Learning
T-GINEE combines CP tensor decomposition with a generalized estimating equation framework and task-specific loss to explicitly model inter-layer correlations in multilayer graphs while providing consistency and asympt...
-
KromHC: Manifold-Constrained Hyper-Connections with Kronecker-Product Residual Matrices
KromHC uses Kronecker products of small doubly stochastic matrices to make Hyper-Connection residual matrices exactly balanced with O(n^2C) parameters, and matches or beats prior variants on small LLM pretraining runs.
-
Neuralized Fermionic Tensor Networks for Quantum Many-Body Systems
NN-fTNS enhance fermionic tensor networks with neural parametrization to improve expressivity and achieve order-of-magnitude better energies than pure fTNS on Hubbard models while maintaining linear scaling.
-
Hybrid between biologically and quantum-inspired many-body states
A perceptrain-based variational ansatz achieves relative ground-state energy accuracy of 10^{-5} (VMC) to 10^{-6} (GFMC) on a 10x10 transverse-field Ising model with 1/r^6 interactions using ranks of only 2-5.
-
Automatically Differentiable Nonlinear Tensor Networks (ADNTNs) for Exponential Parameter Compression of Deep Neural Networks
Hierarchical nonlinear tensor networks generate dense, conv, and attention weights from few cores, yielding extreme per-layer compression with competitive CIFAR-10 accuracy on VGG-16.
-
Tensor-Augmented Convolutional Neural Networks: Enhancing Expressivity with Generic Tensor Kernels
A two-layer tensor-augmented CNN reaches 93.7% test accuracy on Fashion-MNIST, matching or exceeding deeper models like VGG-16 and GoogLeNet by using tensors for richer expressivity.
-
Entanglement is Half the Story: Post-Selection vs. Partial Traces
A hybrid tensor network framework interpolates between classical and quantum models via controllable post-selection, with a trainable hyperparameter that complements bond dimension to enhance quantum machine learning.
-
When AI meets quantum information: A comprehensive review
A comprehensive review organizing progress at the AI-quantum information intersection from both directions.
-
Quantum-inspired tensor networks in machine learning models
Tensor networks developed for quantum states are reviewed as tools for machine learning models, with assessment of their potential computational, explanatory, and privacy advantages alongside remaining challenges.
-
A review of quantum machine learning and quantum-inspired applied methods to computational fluid dynamics
A survey of variational quantum algorithms, quantum neural networks, and tensor networks for addressing scalability challenges in computational fluid dynamics.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.