DAM derives per-layer and per-head attention masks from a calibration dataset and extrapolates them to long inputs, matching full-attention retrieval accuracy while reducing memory and compute.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
DAM: Dynamic Attention Mask for Long-Context Large Language Model Inference Acceleration
DAM derives per-layer and per-head attention masks from a calibration dataset and extrapolates them to long inputs, matching full-attention retrieval accuracy while reducing memory and compute.