REVIEW 11 cited by
Fully Hyperbolic Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Hyperbolic neural networks have shown great potential for modeling complex data. However, existing hyperbolic networks are not completely hyperbolic, as they encode features in a hyperbolic space yet formalize most of their operations in the tangent space (a Euclidean subspace) at the origin of the hyperbolic space. This hybrid method greatly limits the modeling ability of networks. In this paper, we propose a fully hyperbolic framework to build hyperbolic networks based on the Lorentz model by adapting the Lorentz transformations (including boost and rotation) to formalize essential operations of neural networks. Moreover, we also prove that linear transformation in tangent spaces used by existing hyperbolic networks is a relaxation of the Lorentz rotation and does not include the boost, implicitly limiting the capabilities of existing hyperbolic networks. The experimental results on four NLP tasks show that our method has better performance for building both shallow and deep networks. Our code will be released to facilitate follow-up research.
Forward citations
Cited by 11 Pith papers
-
New non-Euclidean neural quantum states from hyperbolic Lorentz recurrent architectures
On 100-site Heisenberg J1-J2 and J1-J2-J3 chains, hyperbolic Poincaré/Lorentz RNN and GRU neural quantum states mostly beat Euclidean counterparts; Lorentz RNN wins four of eight settings despite about three times few...
-
Advancing Multimodal Fusion on Heterogeneous Medical Data with Hybrid Geometry Attention
CURE, a cascaded fusion framework with hybrid hyperbolic/quantum attention, reports state-of-the-art accuracy and lower compute on 16 medical datasets.
-
HyPCV-Former: Hyperbolic Spatio-Temporal Transformer for 3D Point Cloud Video Anomaly Detection
HyPCV-Former embeds point cloud video features in Lorentzian hyperbolic space and uses hyperbolic attention to improve video anomaly detection on two benchmarks.
-
HLFormer: Enhancing Partially Relevant Video Retrieval with Hyperbolic Learning
HLFormer adds hybrid Euclidean and Lorentz attention plus a partial-order cone loss to partially relevant video retrieval and reports the best total recall on ActivityNet Captions, Charades-STA, and TVR.
-
Even Faster Hyperbolic Random Forests: A Beltrami-Klein Wrapper Approach
Fast-HyperDT reexpresses HyperDT as pre- and post-processing around standard Euclidean trees, making hyperbolic random forests practical.
-
Hgformer: Hyperbolic Graph Transformer for Recommendation
Hgformer is a hyperbolic graph transformer for collaborative filtering that reports improved recall and NDCG on six datasets, but its linear-attention approximation is not actually unbiased as claimed.
-
Lorentzian Residual Neural Networks
LResNet performs hyperbolic residual connections with a normalized weighted sum (the Lorentzian centroid), avoiding tangent-space mappings and improving efficiency and accuracy in hyperbolic GNNs, graph transformers, ...
-
Adversarial Attacks on Hyperbolic Networks
Hyperbolic versions of FGM and PGD attacks are proposed, and experiments show that Euclidean and hyperbolic ResNets have different, geometry-specific adversarial vulnerabilities.
-
Multi-Order Hyperbolic Graph Convolution and Aggregated Attention for Social Event Detection
MOHGCAA, a multi-order hyperbolic graph convolution with aggregated attention, is reported to outperform prior Euclidean and hyperbolic baselines on four datasets in supervised and unsupervised settings.
-
Revisiting the Necessity of Graph Learning and Common Graph Benchmarks
Tuned feature-only MLPs nearly match graph neural networks on five common graph benchmarks, suggesting those benchmarks measure feature quality more than graph learning.
-
Hyperbolic Deep Learning for Foundation Models: A Survey
A structured survey of hyperbolic-geometry methods for foundation models, concluding the approach is promising but showing limited independent evidence at scale.
Discussion (0). Continue with ORCID to comment.