Multi-layer Transformers achieve better approximation for k-th largest retrieval tasks than single-layer ones, with the InfoFlow framework tracking information propagation to explain the gap.
Let W T Q,1,2WK,1,2 =A∈R 6×6, where A2,1 = −2 is the only non-zero element of A
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
InfoFlow: A Framework for Multi-Layer Transformer Analysis
Multi-layer Transformers achieve better approximation for k-th largest retrieval tasks than single-layer ones, with the InfoFlow framework tracking information propagation to explain the gap.