Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T11:52:37.270748Z
Paper Citation Record · LEDGER
As of 11 August 2026, this Paper Citation Record lists 43 of 43 outbound references and 7 inbound Pith citation observations for arXiv:2412.14964.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-11T11:52:37.270748Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-07T06:04:31.647548Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-07-02T07:56:47.730179Z
43 of 43 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 03e56360-c8f8-4595-8e27-5336625d58f7 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation GPT-4 Technical Report
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 47d91a7d-ffe6-4e50-8395-36040de64166 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Adapting Language Models to Compress Contexts
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 56089bf7-56f8-46e6-a1b0-93035819f9a5 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation The Llama 3 Herd of Models
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7470d0fb-9905-4fb6-9e1e-93189fe3665b · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation The False Promise of Imitating Proprietary LLMs
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7796b37f-3803-4045-92a5-8329e84c5a90 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Don't Stop Pretraining: Adapt Language Models to Domains and Tasks
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9578ef48-9612-46c7-8956-972139b897bf · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Distilling the Knowledge in a Neural Network
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6126f122-a95f-4b8c-982d-f151609a3ea6 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2d269c3c-e99d-432c-9a0b-87bbf3a0aaa8 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 805153a0-8015-4b22-91e7-c5dee28c07b2 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Generalization through Memorization: Nearest Neighbor Language Models
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 763a6aab-fa9c-41fb-ac48-d46c6e206bb6 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation RA-DIT: Retrieval-Augmented Dual Instruction Tuning
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e457e219-f634-44d5-a729-f0ae9a5cce2f · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Structure-aware Domain Knowledge Injection for Large Language Models
Reference 19
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation ef842316-cf51-4bb9-a7ce-5973f06ce800 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation ChatQA: Surpassing GPT-4 on Conversational QA and RAG
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d9b8178e-5f41-4a8a-ab2b-ab4c75d8a82d · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 03a92b77-3952-4e84-b964-e741a3d76cf3 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Injecting New Knowledge into Large Language Models via Supervised Fine-Tuning
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e55a76c8-fa4c-4235-b91f-3c9b16d18ec2 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Orca 2: Teaching Small Language Models How to Reason
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 26f47e3f-fd91-49cd-95c9-4cc7954909a3 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation XtremeDistil: Multi-stage Distillation for Massive Multilingual Models
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7fe94a89-d997-4c74-b92f-321de45756cd · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Orca: Progressive Learning from Complex Explanation Traces of GPT-4
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a180c0bd-0333-46ef-aed6-f19a61b16814 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Learning to Generate Instruction Tuning Datasets for Zero-Shot Task Adaptation
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 46ae1da7-bb1f-4efc-9158-6a63d3e710b9 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a7e5019a-b4ba-410f-b011-5f50298570a3 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Instruction Tuning with GPT-4
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1154c72e-e39c-4a94-93eb-bcfe8809d26c · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation In-Context Editing: Learning Knowledge from Self-Induced Distributions
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9f8816d2-bda9-4d46-8d19-94c6926739ec · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Multitask Prompted Training Enables Zero-Shot Task Generalization
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a716a0cc-f600-487b-afc5-c2031fd2c167 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation REPLUG: Retrieval-Augmented Black-Box Language Models
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ed94ebae-474a-4acb-a0d6-1e8c7e463793 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation InstructRetro: Instruction Tuning post Retrieval-Augmented Pretraining
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6a66c2b8-fb06-43a0-8531-eda96ea69d6c · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation In-Context Former: Lightning-fast Compressing Context for Large Language Model
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 923c68cc-4294-4dd4-a31e-c97c1eb74b92 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dbb9e362-91b0-48c8-ab4d-527e837e71b0 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation RAFT: Adapting Language Model to Domain Specific RAG
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 41bedcf0-75ff-4798-ae30-f499cb4282e0 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Unresolved cited work
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 04e9f70e-b46c-466b-8655-729caef3457b · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation C Related Work: More Detailed Review of Context Distillation In prior work, context distillation has been used for in-context learning and qualitatively modifying LLM behavior
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 9cbae46e-8cd4-4a99-91cb-f11120cdc24f · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation We found Bonito capable of generating competitive questions for the New York Times dataset
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 9b9bc418-12e8-4212-bca3-54286de8d69b · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation To explore potential factors underlying this phenomenon, we examine two key statistical properties of the teacher model’s outputs:
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 84748132-158c-4def-b593-fbe1bb9e97ad · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation This characteristic may help explain why Llama-3- 8B-Instruct demonstrates superior performance as an expert compared to Qwen2.5-72B-Instruct (Table 3)
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 241a108e-0ec2-4009-a715-e53238617d53 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Splendid Cities
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 123ed824-d287-4346-b5ab-1066c915c06f · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Reference 2011
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f5475e12-fc41-4d5d-a90e-3e6d776adc2f · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation LoRA: Low-Rank Adaptation of Large Language Models
Reference 2015
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8b57b03b-a881-4fed-b327-2bbbb52cb362 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Tulu 3: Pushing Frontiers in Open Language Model Post-Training
Reference 2017
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 54ab17d3-19ec-4103-9bdb-3bbfe2983a89 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Qilin-Med: Multi-stage Knowledge Injection Advanced Medical Large Language Model
Reference 2018
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 072dd78b-6d67-4811-a065-c09d41319785 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Prompt Injection: Parameterization of Fixed Inputs
Reference 2019
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 992cede1-a7a6-4848-b9c0-527f3f93f629 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Revisiting Self-Training for Neural Sequence Generation
Reference 2020
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3973a647-d213-43d5-a2d9-69ab10f3e25e · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Quantifying Memorization Across Neural Language Models
Reference 2021
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5740aedf-cc3a-4b95-bee8-5e89c618310e · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation Language models are few-shot learners
Reference 2022
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2a09967e-9457-49e0-a6fd-06aa0687e991 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation RAG vs Fine-tuning: Pipelines, Tradeoffs, and a Case Study on Agriculture
Reference 2023
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 28f18322-0f4e-4095-974c-ca52efd91650 · outbound
Efficient Knowledge Injection in LLMs via Self-Distillation A General Language Assistant as a Laboratory for Alignment
Reference 2024
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f90dd867-10d9-4bb4-b121-883f62cffc77 · inbound
Cartridges: Lightweight and general-purpose long context representations via self-study Efficient Knowledge Injection in LLMs via Self-Distillation
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e20039dd-2798-4308-8d3c-9870e2fd9dc7 · inbound
Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe Efficient Knowledge Injection in LLMs via Self-Distillation
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation fa696f57-f44a-4620-86a8-feb61f88b25c · inbound
Context Memorization for Efficient Long Context Generation Efficient Knowledge Injection in LLMs via Self-Distillation
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 30f0f7d0-80a4-4a18-96fd-14e643e083d5 · inbound
Language Models Need Sleep: Learning to Self-Modify and Consolidate Memories Efficient Knowledge Injection in LLMs via Self-Distillation
Reference 77
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 9db19840-b7a8-45e5-9367-6f811e4c40c4 · inbound
Language Models Need Sleep: Learning to Self-Modify and Consolidate Memories Efficient Knowledge Injection in LLMs via Self-Distillation
Reference 77
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2cbc327f-02d1-47a7-90a5-93bd6eb5c31b · inbound
Rethinking Continual Experience Internalization for Self-Evolving LLM Agents Efficient Knowledge Injection in LLMs via Self-Distillation
Reference 72
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.
Observation 0d92bd82-ed75-4d1e-914f-a3c13bc959a5 · inbound
Self-Study Reconsidered: The Hidden Fragility of Learning from Self-Generated QA Efficient Knowledge Injection in LLMs via Self-Distillation
Reference 17
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.