Paper Citation Record · LEDGER

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration

As of 5 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 0 inbound Pith citation observations for arXiv:2604.00004.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.00004 v2

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T18:36:58.738624Z

measured 21 of 21 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-04T06:34:03.388597+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

21 of 21 outbound references displayed

verified exact0
verified fuzzy0
unresolved21
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 8374c949-af56-49d9-a21c-f1b3ec089061 · outbound

This paper cites Mathqa: Towards interpretable math word problem solving with operation-based for- malisms.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Mathqa: Towards interpretable math word problem solving with operation-based for- malisms

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:56.772379Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8f13807a-c46a-4973-a619-2c920ec3f85a · outbound

This paper cites MiniLLM: On-Policy Distillation of Large Language Models.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration MiniLLM: On-Policy Distillation of Large Language Models

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.505155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 13006a82-957c-4953-acda-85add7212fb6 · outbound

This paper cites Seekr: Selective attention-guided knowledge retention for continual learning of large language models.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Seekr: Selective attention-guided knowledge retention for continual learning of large language models

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.596676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c09d01a6-b0cb-4257-9ecc-0de36fa206d9 · outbound

This paper cites Measuring Massive Multitask Language Understanding.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Measuring Massive Multitask Language Understanding

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.714533Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 29209fcf-baf5-4af9-8f91-a6aa6013c5d3 · outbound

This paper cites Distilling the Knowledge in a Neural Network.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Distilling the Knowledge in a Neural Network

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.830555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24e3ec75-1195-4eac-84a1-ad6c5708bdbb · outbound

This paper cites Continual Pre-training of Language Models.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Continual Pre-training of Language Models

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.134724Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eecc9e0f-96d6-4efd-9d5d-d6253df7e48a · outbound

This paper cites Ring Attention with Blockwise Transformers for Near-Infinite Context.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Ring Attention with Blockwise Transformers for Near-Infinite Context

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.226812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d31e00f6-235b-456f-bd67-964d303fbd17 · outbound

This paper cites Can a suit of armor conduct electricity? a new dataset for open book question answering.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Can a suit of armor conduct electricity? a new dataset for open book question answering

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.331001Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10851ea7-cfdb-4909-9690-c82d3371ae35 · outbound

This paper cites DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.507852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d87b88b-e1df-4ad7-90e5-677193b745f5 · outbound

This paper cites SocialIQA: Commonsense Reasoning about Social Interactions.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration SocialIQA: Commonsense Reasoning about Social Interactions

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.597130Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4e94fba5-c75e-4bde-82a2-b1656a3cc761 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.660947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e7f012fa-99a7-4e72-bd3d-45afcfc72190 · outbound

This paper cites Minilmv2: Multi-head self-attention relation distillation for compressing pretrained transformers.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Minilmv2: Multi-head self-attention relation distillation for compressing pretrained transformers

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.738624Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ee7d8a08-9594-425a-81be-3c30b3bafeae · outbound

This paper cites RULER: What's the Real Context Size of Your Long-Context Language Models?.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration RULER: What's the Real Context Size of Your Long-Context Language Models?

Reference 2015

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.917048Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c4575a3-1d43-4a34-9150-dda75b142b3c · outbound

This paper cites YaRN: Efficient Context Window Extension of Large Language Models.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration YaRN: Efficient Context Window Extension of Large Language Models

Reference 2016

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.433919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation db9b9e8c-d98e-4d83-8470-64976c521391 · outbound

This paper cites FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

Reference 2018

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.205639Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eca1bcc6-7d82-4288-bc07-4a7fc2defb23 · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 2019

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.114048Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17bd620d-ea2c-460e-95be-c60fe0029410 · outbound

This paper cites Extending Context Window of Large Language Models via Positional Interpolation.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Extending Context Window of Large Language Models via Positional Interpolation

Reference 2020

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:56.893746Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 989aaedd-66e9-46f0-86f7-bbca0612b0fe · outbound

This paper cites Tinybert: Distilling bert for natural language understanding.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration Tinybert: Distilling bert for natural language understanding

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:58.019283Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ad0a4e4-b2a1-408c-b795-eb13a3df7cb3 · outbound

This paper cites BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.007642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 29e05937-0a56-4a95-a2ec-8d0fcde0e92b · outbound

This paper cites LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.326532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2524449e-6b1a-47cb-bcf9-c2e81416e808 · outbound

This paper cites The Llama 3 Herd of Models.

LinearARD: Linear-Memory Attention Distillation for RoPE Restoration The Llama 3 Herd of Models

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-02T18:36:57.394526Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.