Pith. sign in

Paper Citation Record · LEDGER

Distillation Scaling Laws

As of 23 August 2026, this Paper Citation Record lists 39 of 39 outbound references and 24 inbound Pith citation observations for arXiv:2502.08606.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.08606 v2

Coverage vector

measured 39 of 39 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T04:33:08.965380Z

measured 63 of 63 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 24 of 24 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T12:31:58.720593Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-10T10:27:02.464784Z

Reference resolution

39 of 39 outbound references displayed

  • verified exact1
  • verified fuzzy14
  • unresolved20
  • parse uncertain0
  • malformed identifier4
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0cf02cdc-44dd-4812-9912-0b4874b7e6b7 · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-08T04:33:09.691955Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.898143Z digest=sha256:db02af24283daf067082c4a857913b65d29a19e9cd59a0ae632659e5fe895015

Observation ff592dfe-3e75-4c02-99ee-a51ee31e2081 · outbound

This paper cites Our setting automatically satisfies consistency as there is no augmentation policy.

Distillation Scaling Laws Our setting automatically satisfies consistency as there is no augmentation policy

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.679681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.902574Z digest=sha256:f1334edf6c500a69b705b68c47070b6bf3d1a47443e2afc0cce6affc8b53409b

Observation bbcefb85-f25a-4720-a285-76e453384a57 · outbound

This paper cites URL https: //doi.org/10.1145/3604930.3605705.

Distillation Scaling Laws URL https: //doi.org/10.1145/3604930.3605705

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.820573Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.820573Z digest=sha256:342941a8df40233b3c22d1f1d5ce270f330281dd90762633383a558eafe96a04

Observation 0ec3c9cc-4c3c-4a7c-aa84-ae39adb9d64e · outbound

This paper cites DeepSeek-V3 Technical Report.

Distillation Scaling Laws DeepSeek-V3 Technical Report

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.824784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.824784Z digest=sha256:b82f207402bda8af87e8005b63bb37b9f30652ced0889fb4b9bc597ba028923e

Observation 67a722ad-a368-49fe-803c-1f6f4d4e8ccf · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.829410Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.829410Z digest=sha256:654306c4d7615f82d7aadfef553ef1e1a7b4501ddde745235b2d54d7f294e18b

Observation dbcd7b26-66fc-4ff8-8dd8-f220deaeb5a1 · outbound

This paper cites Ac- cessed: 2025-02-11.

Distillation Scaling Laws Ac- cessed: 2025-02-11

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.703922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.833869Z digest=sha256:5d19f9369ab100053b33c18fa3251dfbab9699846e09b7ba5f2dbad356bb4c0e

Observation d33897f2-e73e-469d-92dc-6f938b6374a2 · outbound

This paper cites Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data.

Distillation Scaling Laws Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data

Reference 10

Resolution
verified exact
local_arxiv, observed 2026-08-08T04:33:09.097480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.842135Z digest=sha256:44d7e5d7b6ca77dcd42e269d0b64499ea76137053e679f30f2190726a703ca0d

Observation b4c47448-072d-4586-af12-04ffd7ce7466 · outbound

This paper cites Deep Learning Scaling is Predictable, Empirically.

Distillation Scaling Laws Deep Learning Scaling is Predictable, Empirically

Reference 11

Resolution
malformed identifier
no resolver link, observed 2026-08-08T04:33:08.846677Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.846677Z digest=sha256:4ce1b05628243505ce3005fe601d83a9b9bd3d526cdcc1f08c7067a3b61b9a23

Observation e701b72f-61a3-4382-a170-c53d77a6cfd5 · outbound

This paper cites URL https: //doi.org/10.1145/3458817.3476209.

Distillation Scaling Laws URL https: //doi.org/10.1145/3458817.3476209

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.860221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.860221Z digest=sha256:521563705c30da718347fb20b0498754e5ccfe48d171f33f79f0de6a89a722b0

Observation fb5b7d31-a71b-423a-8b56-6e6b2783af4e · outbound

This paper cites GPT-4 Technical Report.

Distillation Scaling Laws GPT-4 Technical Report

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.868098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.868098Z digest=sha256:6dccef44d56272fb07202c083ee3ed396304c39194b042becc40c9e98a265f89

Observation 4469a440-1847-4aa5-ae3c-20980ad64f8f · outbound

This paper cites Sakaguchi, K., Bras, R.

Distillation Scaling Laws Sakaguchi, K., Bras, R

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.880821Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.880821Z digest=sha256:2cab54ae00b3a9eb4448c0b1d8eacf0480f37d974c8a6bc4eb37d6aed1af6d41

Observation d722c0da-80ad-4efa-91bd-18acfe642a8b · outbound

This paper cites GLU Variants Improve Transformer.

Distillation Scaling Laws GLU Variants Improve Transformer

Reference 20

Resolution
malformed identifier
no resolver link, observed 2026-08-08T04:33:08.884623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.884623Z digest=sha256:a8d91871cd01060a780ffc8775a166084b2cdc5996d67d2ad55018a9b76cc1c3

Observation a8bdbfd2-4567-4c01-a144-96df8f736538 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Distillation Scaling Laws LLaMA: Open and Efficient Foundation Language Models

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.888374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.888374Z digest=sha256:94f995a51141fd762796ca734edb56b04902316a3bd57ede300df45646d85092

Observation ae19f48c-11d1-4419-8ce7-488269625b29 · outbound

This paper cites Tensor Programs IVb: Adaptive Optimization in the Infinite-Width Limit.

Distillation Scaling Laws Tensor Programs IVb: Adaptive Optimization in the Infinite-Width Limit

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.892592Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.892592Z digest=sha256:0b3f41f64ea20d2c5fd53816fba88e4cf57f5ad9f01a293bd2fa382dbb7a22e2

Observation 27880ec8-32eb-4de6-87b0-6935a0c17ca4 · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-08T04:33:09.667768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.906438Z digest=sha256:b51d4f180fea91fd3387ce4f42bb9191fe0c7b48efefd0a7186e02943c8692b7

Observation f97e33fc-4cad-450a-9e1f-74c76420ac5f · outbound

This paper cites The second statement implies that the student should not be trained for too long, appearing to contradict patient teachers.

Distillation Scaling Laws The second statement implies that the student should not be trained for too long, appearing to contradict patient teachers

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.655816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.910439Z digest=sha256:b74ac620f6683834ebf3dd2c5b5b30a661fea5c0c51fd484baf9c3c6b8067d8d

Observation ab801d9b-2575-4ac7-88f3-3e2aa932a1cf · outbound

This paper cites (2022) do not see the teacher training distribution directly, whereas ours do.

Distillation Scaling Laws (2022) do not see the teacher training distribution directly, whereas ours do

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.643137Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.914347Z digest=sha256:89856a2a6e1e2a263b359d606f80af305e5fb68b4418c8e8424b516378daac23

Observation 10300036-a0d0-4eda-91a3-0fd8cced1d25 · outbound

This paper cites The absence of a supervised baseline means that Beyer et al.

Distillation Scaling Laws The absence of a supervised baseline means that Beyer et al

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.630208Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.918968Z digest=sha256:ca0ab4f97480f94f95c215475bc1d8ae29e35740d0adc5a0fd852ad4e6e8a81b

Observation 7434c1b3-6f8a-46e1-8515-b763c858b8d2 · outbound

This paper cites an unresolved cited work.

Distillation Scaling Laws Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-08T04:33:09.617404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.924619Z digest=sha256:20ab69dc07e33636136670de1d779b9dfc38bb65c4f0d98daf25937a529ec828

Observation 6232092c-f886-4d6b-a4da-8c7f288b93aa · outbound

This paper cites Calibration against ground-truth.

Distillation Scaling Laws Calibration against ground-truth

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.605397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.928627Z digest=sha256:6347ee3788c9f422b8d7751cd173140d7b2bd138d001dba7b90aba0564b8f476

Observation af8cc276-2ebd-41de-90b5-11c2c4991b7d · outbound

This paper cites In Figure 43a, we observe that the student is well-calibrated against ground truth data.

Distillation Scaling Laws In Figure 43a, we observe that the student is well-calibrated against ground truth data

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.592707Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.932536Z digest=sha256:baafe8eb744586c5a11db345d7a5bbbc9210fbc4651514ec8836294f5dfa4865

Observation 74dda7a2-8a3d-4dbc-89d7-e2eea1d93cd0 · outbound

This paper cites In Figure 43b, we see that a student trained only on its teacher’s top- 1 prediction, is not calibrated against ground truth data.

Distillation Scaling Laws In Figure 43b, we see that a student trained only on its teacher’s top- 1 prediction, is not calibrated against ground truth data

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.579687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.936630Z digest=sha256:ea33da3f851a4d76f07de610b2428d7ac83d052a468b083259f46de524d9d4a0

Observation 7588fe58-2692-4886-87f2-7dd936511498 · outbound

This paper cites We see in Figure 44a that when distilled from the full teacher distribution, the student is not calibrated against the teacher top-1.

Distillation Scaling Laws We see in Figure 44a that when distilled from the full teacher distribution, the student is not calibrated against the teacher top-1

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.565789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.940775Z digest=sha256:e61de578cfe2a4a5b6167aebefdac68f0fb0655d19caa69f4bb8a5f9378c9d3e

Observation 2b6e0cef-53e3-4096-b295-7c097ef841f9 · outbound

This paper cites In Figure 44b we observe that a student is distilled from its teacher’s top- 1 is calibrated with respect to teacher’s top-1.

Distillation Scaling Laws In Figure 44b we observe that a student is distilled from its teacher’s top- 1 is calibrated with respect to teacher’s top-1

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.552029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.944661Z digest=sha256:729f2736a138b12b7142ef43a7a7eed2591cfebfebc8d16e1fe66c1fe1dcf4ad

Observation 533b196c-f6b9-4838-990a-8a88f453416a · outbound

This paper cites In Figure 45a, we see that when the student is confident, it matches the teacher confidence.

Distillation Scaling Laws In Figure 45a, we see that when the student is confident, it matches the teacher confidence

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.537667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.948608Z digest=sha256:e6341f327a29c2c04b67d3440e41291bd049946038055ff1bae782cd742e7e67

Observation 0129476a-52e3-4dfa-ab9f-c06f2e3cc103 · outbound

This paper cites In Figure 45b, for small teachers, we observe student overconfidence.

Distillation Scaling Laws In Figure 45b, for small teachers, we observe student overconfidence

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.524211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.952632Z digest=sha256:e342ce070a347a2eebbadccec25ae361a03951c546557048cadabc342beaaf0b

Observation 9470eed0-8160-42ae-85c1-b31ac10b4a9f · outbound

This paper cites In Figure 45a we complete the picture from Figure 45a and see that the part of the distribution the student struggles to model is actually the place where teacher is most confident.

Distillation Scaling Laws In Figure 45a we complete the picture from Figure 45a and see that the part of the distribution the student struggles to model is actually the place where teacher is most confident

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.510816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.956574Z digest=sha256:869374175295dd4816b30398c7998704c7914e14b278f355ea05778061ae751d

Observation 1bbf89e8-9b3d-4028-a63c-7df71ec13445 · outbound

This paper cites log LT , −c0 log LT − c1f1 log 1 + LT d1 eLS 1/f1 ! + γ log A′ N α S + B′ Dβ S !# (48) = LSE.

Distillation Scaling Laws log LT , −c0 log LT − c1f1 log 1 + LT d1 eLS 1/f1 ! + γ log A′ N α S + B′ Dβ S !# (48) = LSE

Reference 38

Resolution
malformed identifier
raw_fallback, observed 2026-08-08T04:33:09.498103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.960334Z digest=sha256:216f27e752cc7ad808f7eb3629aaa2f2a856351e9f50b47b6019fdbf3f142377

Observation 835a8686-e627-4015-9aa0-98d38a1660eb · outbound

This paper cites For all experiments, the English-only subset of the C4 dataset (Raffel et al., 2020) is used.

Distillation Scaling Laws For all experiments, the English-only subset of the C4 dataset (Raffel et al., 2020) is used

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T04:33:09.484714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-08T04:33:08.965380Z digest=sha256:49c15a4c1097b46594e207c8708bf5d2ba38cd07310f015edbedb67afe1ccbc3

Observation f048f31d-d5af-4de3-ab61-f6cc1fcc0328 · outbound

This paper cites Textbooks Are All You Need II: phi-1.5 technical report.

Distillation Scaling Laws Textbooks Are All You Need II: phi-1.5 technical report

Reference 507

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.851423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.851423Z digest=sha256:45bda48a91179af1ab7738835ee2c4299c107261cce8dc9546e3a27245b2f49f

Observation fa8018af-c72d-45cd-8f50-81f75b32db0e · outbound

This paper cites GPT-4 Technical Report.

Distillation Scaling Laws GPT-4 Technical Report

Reference 2008

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.864303Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.864303Z digest=sha256:2c32e57e363627caa6474267fba1da79fe5b383b564747a3a70bf57abe59bcf4

Observation 94421901-dfec-4354-90cc-edb3ed015057 · outbound

This paper cites Language models scale reliably with over-training and on downstream tasks.

Distillation Scaling Laws Language models scale reliably with over-training and on downstream tasks

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.837672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.837672Z digest=sha256:2aa740bfed63a2599c88ade462dc2ee015ebb79045a8055e1f3f4e591a321401

Observation eaed84e0-cde7-4712-b087-ad4f596e14e9 · outbound

This paper cites A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs.

Distillation Scaling Laws A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.876380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.876380Z digest=sha256:0a073a2435996678dd34ca85c2d81a8e6079ae3eedc149b6d02083b18b1ca961

Observation 6e235190-ae06-4528-b3bb-e4a7a35310cf · outbound

This paper cites An Empirical Study of Scaling Laws for Transfer.

Distillation Scaling Laws An Empirical Study of Scaling Laws for Transfer

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.802494Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.802494Z digest=sha256:b426d8984bbd1c8dfe0e9138f12e99cbd3a6cffd6b458f8814f0e54f7f72ac21

Observation 44a6deed-1c7c-4538-a331-55206dc97900 · outbound

This paper cites Why distillation helps: a statistical perspective.

Distillation Scaling Laws Why distillation helps: a statistical perspective

Reference 2022

Resolution
malformed identifier
no resolver link, observed 2026-08-08T04:33:08.855974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.855974Z digest=sha256:3689891cb6a8eaf80ffdf797309b5d8601afda5e0c864904fce6687963afeefc

Observation a8f55bd0-0c78-4cc7-ba78-957cb1dfe77b · outbound

This paper cites The Calibration Generalization Gap.

Distillation Scaling Laws The Calibration Generalization Gap

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.816244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.816244Z digest=sha256:20ec2fef2ab921b0a4598a01ed0d4350a2ceffd8744d3a56d9ba2944272edd2a

Observation 405b5901-2f94-4530-892e-a0a92d1feb18 · outbound

This paper cites Resolving Discrepancies in Compute-Optimal Scaling of Language Models.

Distillation Scaling Laws Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.872000Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.872000Z digest=sha256:0d647cc8e3679f6795217ab6dcce05dedaa1080208c2939107ec85551c53e62a

Observation 4daaa6fc-522e-4808-8158-03e0f1b67c47 · outbound

This paper cites The Elements of Differentiable Programming.

Distillation Scaling Laws The Elements of Differentiable Programming

Reference 6239

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.811647Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.811647Z digest=sha256:89fb5307fc31383b0bb0abe3e606a7990e47652ed018b6b90c2fbe89f38a33fa

Observation 8a13c364-577a-4170-b639-b970af5e257d · outbound

This paper cites doi: 10.1609/AAAI.V34I05.

Distillation Scaling Laws doi: 10.1609/AAAI.V34I05

Reference 7439

Resolution
unresolved
no resolver link, observed 2026-08-08T04:33:08.807626Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T04:33:08.807626Z digest=sha256:b132e64371014d58e73945e7fbf8f46ba684c8a91ed83070bb905bc76ced6f19

Pith citing papers

Observation b5fcae33-acec-4db6-9ccd-5987bbece965 · inbound

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models cites this paper.

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models Distillation Scaling Laws

Reference 60

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T08:40:41.236055Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-12T08:40:40.910461Z digest=sha256:cd6fa04d5782655531ae3862c527286d65a098e3a3c71a5f6fcbfbe7e8943098

Observation 4b51ad03-b27a-40c5-a18e-dd672b546482 · inbound

Scaling Laws for Data-Efficient Visual Transfer Learning cites this paper.

Scaling Laws for Data-Efficient Visual Transfer Learning Distillation Scaling Laws

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-16T12:31:58.720593Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T12:31:58.720593Z digest=sha256:9d3b11652b46e3401654b16f2901a25b8cd7d6e1b70a8864d3076bad3a78573d

Observation 7471c7ee-c21e-405e-b589-346dcdc6b39c · inbound

Scalable Strategies for Continual Learning with Replay cites this paper.

Scalable Strategies for Continual Learning with Replay Distillation Scaling Laws

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-15T20:36:39.691481Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T20:36:39.691481Z digest=sha256:deccdc5c73fb52a791d3185332fde971e39be0d858d0f38c452c25e9fd90e21f

Observation cb9b0894-42ac-4dd9-9639-356e2dfd57cc · inbound

HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling cites this paper.

HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling Distillation Scaling Laws

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T13:53:44.547375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:53:44.547375Z digest=sha256:0f3eca712f01ddb9ffc44210a50b66c72b01250416abf0bbaaa9bc09a5ddb4d5

Observation dfff7ebc-db84-4914-b3a8-c73ab38c162a · inbound

Improving Respiratory Sound Classification with Architecture-Agnostic Knowledge Distillation from Ensembles cites this paper.

Improving Respiratory Sound Classification with Architecture-Agnostic Knowledge Distillation from Ensembles Distillation Scaling Laws

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T13:21:04.584884Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:21:04.584884Z digest=sha256:ab2ef7afe2e9e425b25e16284753ce356816608e5e5c7cdb8f401e5e04e7ce8c

Observation 7e70aa5e-28f4-4b46-9fbd-1b76d123f189 · inbound

SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thought cites this paper.

SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thought Distillation Scaling Laws

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T12:39:02.284171Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T12:39:02.284171Z digest=sha256:349df2abc414a2196b52e8a4647bfddd5259a0f48d8fd3869caa4a69eb66eba3

Observation 948fd68b-e593-4bce-a013-72f891ed1cd4 · inbound

A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search cites this paper.

A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search Distillation Scaling Laws

Reference 101

Resolution
unresolved
no resolver link, observed 2026-08-07T05:07:39.912256Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T05:07:39.912256Z digest=sha256:b122aa92ed8737d0d2f0207fe347c6e8f91dd4b763e7e3694ab58ef38294270d

Observation f6f109e9-a66f-4efa-9756-7de207a2c72b · inbound

Language Models Improve When Pretraining Data Matches Target Tasks cites this paper.

Language Models Improve When Pretraining Data Matches Target Tasks Distillation Scaling Laws

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T16:53:08.909525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T16:53:08.909525Z digest=sha256:33546b0f16fe23202d97a62baa3c48f513c01e46ee531b63ab85fb742ff95ed6

Observation d9287584-c60c-4e1f-b10f-1b5121db1396 · inbound

Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scaling cites this paper.

Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scaling Distillation Scaling Laws

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-05T12:25:24.197937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T12:25:24.197937Z digest=sha256:a376dacffe38d2b05d2a25c5837e9f340fff2c75f20d5e471badb94a779f6fc5

Observation ab8ee03a-23fd-4e68-b2f7-9b4d65595187 · inbound

Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe cites this paper.

Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe Distillation Scaling Laws

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-11T11:11:06.799350Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-10T15:05:41.683722Z digest=sha256:80d147db1c4ba9a19634d1d7a8a0f6bbad32d8b26e352ee583b0198c80edf7ca

Observation 06a08037-217e-476e-95c0-49f6b5cc9295 · inbound

Attention to Mamba: A Recipe for Cross-Architecture Distillation cites this paper.

Attention to Mamba: A Recipe for Cross-Architecture Distillation Distillation Scaling Laws

Reference 4

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T23:08:25.019226Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-13T23:07:41.022051Z digest=sha256:acd0957e48fbe02990d06396af013b09b6c992024564a6bad640c890e2809a2c

Observation 7abbae8a-218a-41bf-bba6-22ca9e906757 · inbound

Locking Pretrained Weights via Deep Low-Rank Residual Distillation cites this paper.

Locking Pretrained Weights via Deep Low-Rank Residual Distillation Distillation Scaling Laws

Reference 5

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:16:28.199224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-05-12T04:26:13.390232Z digest=sha256:716fde482b0c624dcc59778b323115ea490a54f46f01a3daf46c5dff556e91a1

Observation d6c8bdd3-d23d-4fed-8f2d-34dcd0fc7638 · inbound

Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why cites this paper.

Unmasking On-Policy Distillation: Where It Helps, Where It Hurts, and Why Distillation Scaling Laws

Reference 31

Resolution
verified exact
arxiv_id, observed 2026-05-12T06:11:27.194571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-05-12T04:28:58.679078Z digest=sha256:41673a137b4ead235309f5a3e6435f4cd28e593bcb0297f8c6393f5b67a578d5

Observation 116a3b02-0a7b-4e60-9c4a-882954ad9686 · inbound

GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets cites this paper.

GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets Distillation Scaling Laws

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-20T12:28:16.839876Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-05-20T12:25:39.417436Z digest=sha256:269f70526b425110f913e3bf7b6458cb1001dc226a2ac69a96749e29cfefa26f

Observation 808a10a8-30b8-44f4-979b-5d8fad005d58 · inbound

A Primer in Post-Training Reasoning Data: What We Know About How It Works cites this paper.

A Primer in Post-Training Reasoning Data: What We Know About How It Works Distillation Scaling Laws

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-07-01T23:06:20.492970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-28T14:40:21.583101Z digest=sha256:4823f8e5627e4c3c2d18a0414379a83c52ba8a203ecf384b5206904c1f81bebc

Observation bd734d7d-d47f-4d95-b659-cdcf0c08842e · inbound

Scaling Laws for Task-Specific LLM Distillation cites this paper.

Scaling Laws for Task-Specific LLM Distillation Distillation Scaling Laws

Reference 15

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T17:40:00.709298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-25T23:29:49.787477Z digest=sha256:4016bd83562b45ab300ec9ca88f683acef7a009835e57e08826c7fda099337fb

Observation 43781904-f825-4a0a-ba1a-65d06731e5ba · inbound

DOPD: Dual On-policy Distillation cites this paper.

DOPD: Dual On-policy Distillation Distillation Scaling Laws

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-06-30T05:54:18.565205Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-30T05:51:18.037199Z digest=sha256:315532a891cfe165b29cf04dbb523b3a49ab6ce5b438aa4b28e43e83c3294960

Observation eccf6957-144f-434b-a8d0-1342b8625d63 · inbound

When Does Generating More Help? Disentangling Fixed-Source Synthesis from Source Expansion in Synthetic Data Scaling cites this paper.

When Does Generating More Help? Disentangling Fixed-Source Synthesis from Source Expansion in Synthetic Data Scaling Distillation Scaling Laws

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-07-03T15:28:33.813041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-07-03T15:20:51.474398Z digest=sha256:0424156b4866e772a200e6103243facb536992d24eec50198f907c918330ed60

Observation fcfc1f1d-28b0-4845-8f6b-20e29d53e00e · inbound

Weak-to-Strong Generalization via Direct On-Policy Distillation cites this paper.

Weak-to-Strong Generalization via Direct On-Policy Distillation Distillation Scaling Laws

Reference 30

Resolution
verified exact
local_arxiv, observed 2026-07-07T12:33:45.193910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-07-07T12:31:42.224094Z digest=sha256:8a67fe9475d7eb3b7fef67cd58f28d73e35aa7a988a4080335014937746ea638

Observation 39e87fb7-d8c1-4488-a56e-e9092c417205 · inbound

Weak-to-Strong Generalization via Direct On-Policy Distillation cites this paper.

Weak-to-Strong Generalization via Direct On-Policy Distillation Distillation Scaling Laws

Reference 30

Resolution
unresolved
no resolver link, observed 2026-07-11T07:01:56.628017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T07:01:56.628017Z digest=sha256:1f119c0734f9e82b205e967caa18ab5415c4f9f4bb45fc307ddd28e15514d986

Observation 4f71c4fa-1ba9-4e75-b09b-d704595675a3 · inbound

Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment cites this paper.

Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment Distillation Scaling Laws

Reference 15

Resolution
metadata mismatch
local_arxiv, observed 2026-07-10T10:27:02.465940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-07-10T10:20:46.103409Z digest=sha256:64e0f84116dfc21df5a25f7009a08613d2c4744812eac7f46af027e0ba794efe

Observation a26b1bb5-02e4-49c1-9467-463b64384223 · inbound

Proxy Exploration and Reusable Guidance: A Modular LLM Post-Training Paradigm via Proxy-Guided Update Signals cites this paper.

Proxy Exploration and Reusable Guidance: A Modular LLM Post-Training Paradigm via Proxy-Guided Update Signals Distillation Scaling Laws

Reference 35

Resolution
unresolved
no resolver link, observed 2026-07-14T05:09:00.865375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T05:09:00.865375Z digest=sha256:cf9c38b3ddd0e0f0ba3874e6d2f92ee5f69cc5f94994440608a15c27b8f2d9d4

Observation 57a20919-bb17-49a2-b72b-4a46b27889ec · inbound

Bridging Compute- and Data-Optimal Pretraining cites this paper.

Bridging Compute- and Data-Optimal Pretraining Distillation Scaling Laws

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-01T03:02:01.509903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T03:02:01.509903Z digest=sha256:44268113f2929cf6bf9235427bc92a49a958eb576a83fa8e8f134525b1b6c956

Observation 755b5046-0fc4-408f-aec7-31f6ec3e78b5 · inbound

Skaling: Chinchilla's Exponents Meet Kaplan's Coupling cites this paper.

Skaling: Chinchilla's Exponents Meet Kaplan's Coupling Distillation Scaling Laws

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-10T12:32:57.249732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T12:32:57.249732Z digest=sha256:cbc0cd4ceeacd1d75547756578581df255f1c917dabe447ca3e4c0482724f719