Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-08T04:33:08.965380Z
Paper Citation Record · LEDGER
As of 14 August 2026, this Paper Citation Record lists 39 of 39 outbound references and 22 inbound Pith citation observations for arXiv:2502.08606.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-08T04:33:08.965380Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-10T12:32:57.249732Z
A source-named dated measurement, never combined with another source.
Source: pith, observed 2026-07-10T10:27:02.464784Z
39 of 39 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 0cf02cdc-44dd-4812-9912-0b4874b7e6b7 · outbound
Distillation Scaling Laws Unresolved cited work
Reference 1
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation ff592dfe-3e75-4c02-99ee-a51ee31e2081 · outbound
Distillation Scaling Laws Our setting automatically satisfies consistency as there is no augmentation policy
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation bbcefb85-f25a-4720-a285-76e453384a57 · outbound
Distillation Scaling Laws URL https: //doi.org/10.1145/3604930.3605705
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0ec3c9cc-4c3c-4a7c-aa84-ae39adb9d64e · outbound
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 67a722ad-a368-49fe-803c-1f6f4d4e8ccf · outbound
Distillation Scaling Laws Unresolved cited work
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dbcd7b26-66fc-4ff8-8dd8-f220deaeb5a1 · outbound
Distillation Scaling Laws Ac- cessed: 2025-02-11
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation d33897f2-e73e-469d-92dc-6f938b6374a2 · outbound
Distillation Scaling Laws Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation b4c47448-072d-4586-af12-04ffd7ce7466 · outbound
Distillation Scaling Laws Deep Learning Scaling is Predictable, Empirically
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e701b72f-61a3-4382-a170-c53d77a6cfd5 · outbound
Distillation Scaling Laws URL https: //doi.org/10.1145/3458817.3476209
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fb5b7d31-a71b-423a-8b56-6e6b2783af4e · outbound
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4469a440-1847-4aa5-ae3c-20980ad64f8f · outbound
Distillation Scaling Laws Sakaguchi, K., Bras, R
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d722c0da-80ad-4efa-91bd-18acfe642a8b · outbound
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a8bdbfd2-4567-4c01-a144-96df8f736538 · outbound
Distillation Scaling Laws LLaMA: Open and Efficient Foundation Language Models
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ae19f48c-11d1-4419-8ce7-488269625b29 · outbound
Distillation Scaling Laws Tensor Programs IVb: Adaptive Optimization in the Infinite-Width Limit
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 27880ec8-32eb-4de6-87b0-6935a0c17ca4 · outbound
Distillation Scaling Laws Unresolved cited work
Reference 25
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation f97e33fc-4cad-450a-9e1f-74c76420ac5f · outbound
Distillation Scaling Laws The second statement implies that the student should not be trained for too long, appearing to contradict patient teachers
Reference 26
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation ab801d9b-2575-4ac7-88f3-3e2aa932a1cf · outbound
Distillation Scaling Laws (2022) do not see the teacher training distribution directly, whereas ours do
Reference 27
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 10300036-a0d0-4eda-91a3-0fd8cced1d25 · outbound
Distillation Scaling Laws The absence of a supervised baseline means that Beyer et al
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 7434c1b3-6f8a-46e1-8515-b763c858b8d2 · outbound
Distillation Scaling Laws Unresolved cited work
Reference 29
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 6232092c-f886-4d6b-a4da-8c7f288b93aa · outbound
Distillation Scaling Laws Calibration against ground-truth
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation af8cc276-2ebd-41de-90b5-11c2c4991b7d · outbound
Distillation Scaling Laws In Figure 43a, we observe that the student is well-calibrated against ground truth data
Reference 31
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 74dda7a2-8a3d-4dbc-89d7-e2eea1d93cd0 · outbound
Distillation Scaling Laws In Figure 43b, we see that a student trained only on its teacher’s top- 1 prediction, is not calibrated against ground truth data
Reference 32
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 7588fe58-2692-4886-87f2-7dd936511498 · outbound
Distillation Scaling Laws We see in Figure 44a that when distilled from the full teacher distribution, the student is not calibrated against the teacher top-1
Reference 33
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 2b6e0cef-53e3-4096-b295-7c097ef841f9 · outbound
Distillation Scaling Laws In Figure 44b we observe that a student is distilled from its teacher’s top- 1 is calibrated with respect to teacher’s top-1
Reference 34
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 533b196c-f6b9-4838-990a-8a88f453416a · outbound
Distillation Scaling Laws In Figure 45a, we see that when the student is confident, it matches the teacher confidence
Reference 35
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 0129476a-52e3-4dfa-ab9f-c06f2e3cc103 · outbound
Distillation Scaling Laws In Figure 45b, for small teachers, we observe student overconfidence
Reference 36
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 9470eed0-8160-42ae-85c1-b31ac10b4a9f · outbound
Distillation Scaling Laws In Figure 45a we complete the picture from Figure 45a and see that the part of the distribution the student struggles to model is actually the place where teacher is most confident
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 1bbf89e8-9b3d-4028-a63c-7df71ec13445 · outbound
Distillation Scaling Laws log LT , −c0 log LT − c1f1 log 1 + LT d1 eLS 1/f1 ! + γ log A′ N α S + B′ Dβ S !# (48) = LSE
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 835a8686-e627-4015-9aa0-98d38a1660eb · outbound
Distillation Scaling Laws For all experiments, the English-only subset of the C4 dataset (Raffel et al., 2020) is used
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation f048f31d-d5af-4de3-ab61-f6cc1fcc0328 · outbound
Distillation Scaling Laws Textbooks Are All You Need II: phi-1.5 technical report
Reference 507
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fa8018af-c72d-45cd-8f50-81f75b32db0e · outbound
Reference 2008
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 94421901-dfec-4354-90cc-edb3ed015057 · outbound
Distillation Scaling Laws Language models scale reliably with over-training and on downstream tasks
Reference 2018
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation eaed84e0-cde7-4712-b087-ad4f596e14e9 · outbound
Distillation Scaling Laws A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs
Reference 2020
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6e235190-ae06-4528-b3bb-e4a7a35310cf · outbound
Distillation Scaling Laws An Empirical Study of Scaling Laws for Transfer
Reference 2021
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 44a6deed-1c7c-4538-a331-55206dc97900 · outbound
Distillation Scaling Laws Why distillation helps: a statistical perspective
Reference 2022
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a8f55bd0-0c78-4cc7-ba78-957cb1dfe77b · outbound
Distillation Scaling Laws The Calibration Generalization Gap
Reference 2023
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 405b5901-2f94-4530-892e-a0a92d1feb18 · outbound
Distillation Scaling Laws Resolving Discrepancies in Compute-Optimal Scaling of Language Models
Reference 2024
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4daaa6fc-522e-4808-8158-03e0f1b67c47 · outbound
Distillation Scaling Laws The Elements of Differentiable Programming
Reference 6239
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8a13c364-577a-4170-b639-b970af5e257d · outbound
Distillation Scaling Laws doi: 10.1609/AAAI.V34I05
Reference 7439
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b5fcae33-acec-4db6-9ccd-5987bbece965 · inbound
Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models Distillation Scaling Laws
Reference 60
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation cb9b0894-42ac-4dd9-9639-356e2dfd57cc · inbound
HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling Distillation Scaling Laws
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dfff7ebc-db84-4914-b3a8-c73ab38c162a · inbound
Improving Respiratory Sound Classification with Architecture-Agnostic Knowledge Distillation from Ensembles Distillation Scaling Laws
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7e70aa5e-28f4-4b46-9fbd-1b76d123f189 · inbound
SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thought Distillation Scaling Laws
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 948fd68b-e593-4bce-a013-72f891ed1cd4 · inbound
A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search Distillation Scaling Laws
Reference 101
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f6f109e9-a66f-4efa-9756-7de207a2c72b · inbound
Language Models Improve When Pretraining Data Matches Target Tasks Distillation Scaling Laws
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d9287584-c60c-4e1f-b10f-1b5121db1396 · inbound
Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scaling Distillation Scaling Laws
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ab8ee03a-23fd-4e68-b2f7-9b4d65595187 · inbound
Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe Distillation Scaling Laws
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 06a08037-217e-476e-95c0-49f6b5cc9295 · inbound
Attention to Mamba: A Recipe for Cross-Architecture Distillation Distillation Scaling Laws
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 7abbae8a-218a-41bf-bba6-22ca9e906757 · inbound
Locking Pretrained Weights via Deep Low-Rank Residual Distillation Distillation Scaling Laws
Reference 5
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation d6c8bdd3-d23d-4fed-8f2d-34dcd0fc7638 · inbound
Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why Distillation Scaling Laws
Reference 31
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 116a3b02-0a7b-4e60-9c4a-882954ad9686 · inbound
GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets Distillation Scaling Laws
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 808a10a8-30b8-44f4-979b-5d8fad005d58 · inbound
A Primer in Post-Training Reasoning Data: What We Know About How It Works Distillation Scaling Laws
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation bd734d7d-d47f-4d95-b659-cdcf0c08842e · inbound
Scaling Laws for Task-Specific LLM Distillation Distillation Scaling Laws
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 43781904-f825-4a0a-ba1a-65d06731e5ba · inbound
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation eccf6957-144f-434b-a8d0-1342b8625d63 · inbound
When Does Generating More Help? Disentangling Fixed-Source Synthesis from Source Expansion in Synthetic Data Scaling Distillation Scaling Laws
Reference 1
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation fcfc1f1d-28b0-4845-8f6b-20e29d53e00e · inbound
Weak-to-Strong Generalization via Direct On-Policy Distillation Distillation Scaling Laws
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation 39e87fb7-d8c1-4488-a56e-e9092c417205 · inbound
Weak-to-Strong Generalization via Direct On-Policy Distillation Distillation Scaling Laws
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4f71c4fa-1ba9-4e75-b09b-d704595675a3 · inbound
Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment Distillation Scaling Laws
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.
Observation a26b1bb5-02e4-49c1-9467-463b64384223 · inbound
Proxy Exploration and Reusable Guidance: A Modular LLM Post-Training Paradigm via Proxy-Guided Update Signals Distillation Scaling Laws
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 57a20919-bb17-49a2-b72b-4a46b27889ec · inbound
Bridging Compute- and Data-Optimal Pretraining Distillation Scaling Laws
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 755b5046-0fc4-408f-aec7-31f6ec3e78b5 · inbound
Skaling: Chinchilla's Exponents Meet Kaplan's Coupling Distillation Scaling Laws
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.