Paper Citation Record · LEDGER

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction

As of 22 August 2026, this Paper Citation Record lists 45 of 45 outbound references and 0 inbound Pith citation observations for arXiv:2601.11667.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2601.11667 v2

Coverage vector

measured 45 of 45 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-03T10:12:43.543963Z

measured 45 of 45 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

45 of 45 outbound references displayed

verified exact0
verified fuzzy0
unresolved45
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9939c326-9843-4f7b-a660-cf4f5510c14b · outbound

This paper cites In: The Twelfth International Conference on Learning Representations (2024).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: The Twelfth International Conference on Learning Representations (2024)

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.345860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 83dbf5ec-36f6-4e52-aa00-6738cc2da73a · outbound

This paper cites an unresolved cited work.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Unresolved cited work

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.351039Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 01268683-7886-4eda-a5f5-cd34d926812d · outbound

This paper cites Simple linear attention language models balance the recall-throughput tradeoff.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Simple linear attention language models balance the recall-throughput tradeoff

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.355457Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6365257-6226-447a-9376-12747f3a27d5 · outbound

This paper cites Puzzle: Distillation-Based NAS for Inference-Optimized LLMs.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Puzzle: Distillation-Based NAS for Inference-Optimized LLMs

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.360476Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0da1e75-c7fc-4144-bb0e-701f648bfd7c · outbound

This paper cites In: Proceedings of the AAAI conference on artificial intelligence.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: Proceedings of the AAAI conference on artificial intelligence

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.365325Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aa946a11-5e96-4997-b81e-b28625c0383c · outbound

This paper cites In: Proceedings of the AAAI Conference on Artificial Intelligence.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: Proceedings of the AAAI Conference on Artificial Intelligence

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.369522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4e25b861-2189-4b9e-af16-fddbf105c99b · outbound

This paper cites RedStone: Curating General, Code, Math, and QA Data for Large Language Models.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction RedStone: Curating General, Code, Math, and QA Data for Large Language Models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.374331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e00612ed-0e6c-440d-bc14-2b1cdef265d3 · outbound

This paper cites Rethinking Attention with Performers.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Rethinking Attention with Performers

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.378888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64ff5a9f-82b7-4e10-8680-4db629eecbaa · outbound

This paper cites BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.383254Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c2154892-0075-4504-b8b8-c3467b16bc07 · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.387794Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 787a1d5f-9d73-4b53-8e68-3181dc142f69 · outbound

This paper cites Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.392306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b83e026-48db-4285-9fa0-0126f68688f8 · outbound

This paper cites Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.396788Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9713c075-5dae-4284-ab4f-ec61593245cf · outbound

This paper cites Hungry Hungry Hippos: Towards Language Modeling with State Space Models.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Hungry Hungry Hippos: Towards Language Modeling with State Space Models

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.401295Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f16cecf3-e5e5-4797-8bc5-77fa2237daa9 · outbound

This paper cites an unresolved cited work.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Unresolved cited work

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.405519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3d9adff0-c827-411b-ac9a-e6e1f308b286 · outbound

This paper cites Zamba: A Compact 7B SSM Hybrid Model.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Zamba: A Compact 7B SSM Hybrid Model

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.409911Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c528d24b-7139-438a-a721-e83a0025aef1 · outbound

This paper cites arXiv preprint arXiv:2505.03005 (2025).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction arXiv preprint arXiv:2505.03005 (2025)

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.414088Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 51b282e8-2d62-4ea3-8520-128154bdb4cf · outbound

This paper cites The Llama 3 Herd of Models.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction The Llama 3 Herd of Models

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.418382Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ae71b19d-8de1-4365-9848-55b64eaad903 · outbound

This paper cites In: First conference on language modeling (2024).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: First conference on language modeling (2024)

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.422336Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e159d1bc-d9c2-4792-beb8-aa641cb3b396 · outbound

This paper cites Efficiently Modeling Long Sequences with Structured State Spaces.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Efficiently Modeling Long Sequences with Structured State Spaces

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.426586Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation edb01a16-d2eb-4b17-8eb2-731d22d5d43d · outbound

This paper cites MiniLLM: On-Policy Distillation of Large Language Models.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction MiniLLM: On-Policy Distillation of Large Language Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.431249Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9fe6b860-e05b-44c4-939d-b89709c34735 · outbound

This paper cites arXiv preprint arXiv:2508.15884 (2025).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction arXiv preprint arXiv:2508.15884 (2025)

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.435815Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ee59e748-61b2-47b7-bbc4-053839412456 · outbound

This paper cites Measuring Massive Multitask Language Understanding.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Measuring Massive Multitask Language Understanding

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.440147Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e6529c1-2b5a-4b92-90ff-e982a49a944e · outbound

This paper cites Distilling the Knowledge in a Neural Network.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Distilling the Knowledge in a Neural Network

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.444487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cdd3e326-b7e8-4b66-8cf7-3ecfbc670b79 · outbound

This paper cites an unresolved cited work.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.448994Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc74a54a-7e33-441a-9ed8-cb54d105c41a · outbound

This paper cites In: International conference on machine learning.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: International conference on machine learning

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.452989Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 700e8b2b-a30a-4ed1-b2d9-666830b97d18 · outbound

This paper cites In: The Thirteenth International Conference on Learning Representations (2025).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: The Thirteenth International Conference on Learning Representations (2025)

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.457087Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41fb7ac7-b54e-4f7f-833a-4fb8e6723a0e · outbound

This paper cites A Survey on Transformer Context Extension: Approaches and Evaluation.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction A Survey on Transformer Context Extension: Approaches and Evaluation

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.461332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 536c4b9f-5864-47ad-91e3-23af9f0dfd23 · outbound

This paper cites Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answering

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.466281Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66e45c99-c107-496d-a49b-00dad54ae26a · outbound

This paper cites RWKV: Reinventing RNNs for the Transformer Era.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction RWKV: Reinventing RNNs for the Transformer Era

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.470745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cee4a1bb-6511-4104-8d85-f76dbe1412aa · outbound

This paper cites A Survey of Mamba.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction A Survey of Mamba

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.475185Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 068276b2-d6b2-49bf-a359-2c27da520928 · outbound

This paper cites Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.479932Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 744f92e5-3cbb-4136-a17c-6b02136bafca · outbound

This paper cites Communications of the ACM64(9), 99–106 (2021).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Communications of the ACM64(9), 99–106 (2021)

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.484197Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5d386163-bc91-4fd5-aefa-a80ed141055f · outbound

This paper cites In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.488370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a8851e8-d327-4e72-8585-21cc8ad72d4d · outbound

This paper cites Retentive Network: A Successor to Transformer for Large Language Models.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Retentive Network: A Successor to Transformer for Large Language Models

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.492542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf4ca54e-a0d6-480a-9282-6511ebd87d9a · outbound

This paper cites In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.497616Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e89911bd-6ab5-478a-8be7-90820dc3534d · outbound

This paper cites A Survey on Transformer Compression.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction A Survey on Transformer Compression

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.502045Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9534b521-4957-47ad-ab9b-61e42f1f6a7b · outbound

This paper cites Qwen2 Technical Report.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Qwen2 Technical Report

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.506901Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 073235d7-9b2a-43f2-85b5-711787578248 · outbound

This paper cites Advances in neural information processing systems30(1), 261–272 (2017).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Advances in neural information processing systems30(1), 261–272 (2017)

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.511668Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ec7f5ff8-52bd-45ba-bbde-d32e82a7d91b · outbound

This paper cites An Empirical Study of Mamba-based Language Models.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction An Empirical Study of Mamba-based Language Models

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.516117Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0117f594-6d54-4f2b-a2cf-4af73fa36246 · outbound

This paper cites A Systematic Analysis of Hybrid Linear Attention.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction A Systematic Analysis of Hybrid Linear Attention

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.520679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 894df4eb-a66b-485e-9b74-10a784177146 · outbound

This paper cites Advances in Neural Information Processing Systems37, 62432–62457 (2024).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Advances in Neural Information Processing Systems37, 62432–62457 (2024)

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.525308Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cc553eca-d13c-4844-aba5-a0d6a18677c8 · outbound

This paper cites Crowdsourcing Multiple Choice Science Questions.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Crowdsourcing Multiple Choice Science Questions

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.529744Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0d705e04-0142-4c32-82e3-9a51c9687088 · outbound

This paper cites arXiv preprint arXiv:2505.17272 (2025).

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction arXiv preprint arXiv:2505.17272 (2025)

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.534167Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ffae1b9-8788-42fc-a335-8b19b7fb8773 · outbound

This paper cites Gated Delta Networks: Improving Mamba2 with Delta Rule.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction Gated Delta Networks: Improving Mamba2 with Delta Rule

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.538784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9e99d2c7-d130-441b-a041-22320f460592 · outbound

This paper cites In: International Conference on Machine Learning.

Distill-then-Replace: Efficient Task-Specific Hybrid Attention Model Construction In: International Conference on Machine Learning

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-03T10:12:43.543963Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.