X-LogSMask injects per-head powers of the normalized adjacency matrix via a logarithmic transform into Transformer attention, achieving SOTA results on 13 of 20 graph benchmarks while remaining competitive in a one-layer setup.
Graph transformers without positional encodings.arXiv preprint arXiv:2401.17791, 2024
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
X-LogSMask: Expand Transformer for Graph-Structured Data
X-LogSMask injects per-head powers of the normalized adjacency matrix via a logarithmic transform into Transformer attention, achieving SOTA results on 13 of 20 graph benchmarks while remaining competitive in a one-layer setup.