Paper Citation Record · LEDGER

Improving Continual Pre-training Through Seamless Data Packing

As of 8 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 0 inbound Pith citation observations for arXiv:2505.22018.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.22018 v2

Coverage vector

measured 57 of 57 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:25:05.152317Z

measured 57 of 57 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

57 of 57 outbound references displayed

verified exact4
verified fuzzy2
unresolved49
parse uncertain0
malformed identifier0
metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 92f2fc70-e8d8-42e0-89ee-728afc4b7fdd · outbound

This paper cites GPT-4 Technical Report.

Improving Continual Pre-training Through Seamless Data Packing GPT-4 Technical Report

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T13:24:59.676918Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b004c923-9a57-463c-96a1-64ae616702f3 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T13:24:59.736835Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 26410cd8-a3eb-46a2-bffe-f6d7f50892e1 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 3

Resolution: metadata mismatch; raw_fallback, observed 2026-08-07T13:25:06.654078Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e36e94ea-7b06-418a-a9d4-e3b8a53a49d2 · outbound

This paper cites Costa-jussà.

Improving Continual Pre-training Through Seamless Data Packing Costa-jussà

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-07T13:24:59.933948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c66c8e11-3bf7-4adb-b54e-796987c13763 · outbound

This paper cites Boyer and J.

Improving Continual Pre-training Through Seamless Data Packing Boyer and J

Reference 5

Resolution: metadata mismatch; raw_fallback, observed 2026-08-07T13:25:06.404060Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 1a39fd97-33bc-4cea-84d1-d0496a6a7bd1 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:00.120185Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9965d01f-0f52-44ea-9354-bed045e93516 · outbound

This paper cites Towards Effective and Efficient Continual Pre-training of Large Language Models.

Improving Continual Pre-training Through Seamless Data Packing Towards Effective and Efficient Continual Pre-training of Large Language Models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:00.220733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89026870-3bbf-4593-bf2c-02486f18f52e · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:00.331856Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 00c14430-4a20-4df0-8076-2d983ca345f0 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:00.440060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38138892-a045-4505-9c53-52c31473666a · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:10.468103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 787e83a2-23ea-47f7-819a-9baab3792d60 · outbound

This paper cites The Llama 3 Herd of Models.

Improving Continual Pre-training Through Seamless Data Packing The Llama 3 Herd of Models

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:00.624095Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d17f958d-5336-42f5-9d60-3bbd472d1abe · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:10.215021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 79f2530c-4024-4eed-9247-bf2f3e5e290a · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:10.028214Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation ccafde16-78be-4b74-8e4e-1fca52dd7f30 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:09.749520Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation b9de8ab2-3836-4d89-b264-e79a13d58e9c · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:09.509834Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e9f16a7f-8448-47a4-b992-5bc174a8c97d · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:09.318192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation bc8533c7-a898-470d-aec7-9b243b06b119 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:01.261255Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcf73207-2782-49df-8cf0-d672817812db · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:01.381077Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2082b4fd-66dd-417c-8f3d-d42634386211 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 19

Resolution: verified exact; doi, observed 2026-08-07T13:25:05.929853Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 899a1153-e334-4836-9ba1-b4274c8300eb · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:09.149923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f194c969-22cd-42cc-b439-409cbbaa4050 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:09.026850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 9bd2ee53-802c-4223-ad8b-7d389609dbe3 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 22

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:08.848746Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 138c23d1-b1d3-4c9d-9f1c-1d759e282e03 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:01.960574Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d04642e6-f87f-48c1-bf1b-a38f2e19acf0 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:08.692847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation fa298d58-05cf-4a78-9931-9c03e038f680 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:08.537652Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 81271175-d08e-478e-8b79-79d3f9e39bf0 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:08.362889Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 01aa034a-441e-426b-8fdc-971fc3214d4e · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 27

Resolution: verified exact; doi, observed 2026-08-07T13:25:05.737312Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 3e858a97-754b-47a2-ba15-87cbe4ce7c94 · outbound

This paper cites Krallinger, O.

Improving Continual Pre-training Through Seamless Data Packing Krallinger, O

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:25:08.177595Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation f6dddd43-912f-4594-baea-afd1cf0d7a60 · outbound

This paper cites Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance.

Improving Continual Pre-training Through Seamless Data Packing Efficient Sequence Packing without Cross-contamination: Accelerating Large Language Models without Impacting Performance

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:02.689938Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 438f3fd5-7b63-4465-8224-1f481cc4c58a · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:02.808286Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cb577b99-5eb0-4a35-8941-a8abae2f51e3 · outbound

This paper cites FlauBERT: Unsupervised Language Model Pre-training for French.

Improving Continual Pre-training Through Seamless Data Packing FlauBERT: Unsupervised Language Model Pre-training for French

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:02.906806Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c8d00175-406c-4230-b189-ec12b6ee7e48 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:03.054504Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ca5ae45f-72b3-42ba-bc76-f594636301c8 · outbound

This paper cites Understanding Continual Learning Settings with Data Distribution Drift Analysis.

Improving Continual Pre-training Through Seamless Data Packing Understanding Continual Learning Settings with Data Distribution Drift Analysis

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:03.182075Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2a02158-2e15-475f-823c-653640b4e7c7 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 34

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:08.000864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation cd03761c-cfe0-40de-9f6c-357de86f7a37 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:03.398842Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b1417c11-1d25-4439-b88e-9982ce3923bc · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:03.501519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be855d3e-9967-4a95-bda2-5709a265ed9a · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 37

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:07.839450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d93ba135-222c-4a13-a92b-4e6cf5a83353 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 38

Resolution: verified exact; doi, observed 2026-08-07T13:25:05.480613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 8230eb59-30ef-43b0-80bc-8520dadeb562 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 39

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:07.638379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 1e91dbab-5100-4063-abef-04dd2069613f · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 40

Resolution: verified exact; doi, observed 2026-08-07T13:25:05.337267Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation b98ded42-805c-4d71-adf5-217622310fc2 · outbound

This paper cites Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models.

Improving Continual Pre-training Through Seamless Data Packing Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.031066Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 30916e74-654e-47c4-86b0-71df6dda2615 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.090902Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ae21b756-da91-45a4-bddf-b58a7093383b · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.148994Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f1e29ea3-a743-4d07-8447-13104507e25d · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.203057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 15656ce3-d042-45b1-b649-bfc7fb60b04d · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 45

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:07.369516Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c73cd322-8381-4659-ba63-b2fd63497325 · outbound

This paper cites Smith, Luke Zettlemoyer, Wen tau Yih, and Mike Lewis.

Improving Continual Pre-training Through Seamless Data Packing Smith, Luke Zettlemoyer, Wen tau Yih, and Mike Lewis

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T13:25:07.165121Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e113d8cb-77ae-4546-84f6-71c7c347fda1 · outbound

This paper cites Gemma 2: Improving Open Language Models at a Practical Size.

Improving Continual Pre-training Through Seamless Data Packing Gemma 2: Improving Open Language Models at a Practical Size

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.480465Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5f35ab69-25b5-4ef1-92b9-c1687da44f25 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

Improving Continual Pre-training Through Seamless Data Packing Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.553625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c5f8d19b-2ac5-4877-bfc3-f9b6cb8aec8a · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.625166Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82b8221f-4315-49a8-9c78-f747fe03e3cb · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.679588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b9e68ba9-24ce-437e-beb2-12ada606bede · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 51

Resolution: unresolved; raw_fallback, observed 2026-08-07T13:25:06.949945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d53ccaee-9b4d-4643-ad30-b9cc3ff75d09 · outbound

This paper cites an unresolved cited work.

Improving Continual Pre-training Through Seamless Data Packing Unresolved cited work

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.825655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf3348ec-a857-40b5-a44f-ba1bd9958e23 · outbound

This paper cites Qwen2 Technical Report.

Improving Continual Pre-training Through Seamless Data Packing Qwen2 Technical Report

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.888904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 66623d61-b2f3-43c3-b73b-f17d713e2447 · outbound

This paper cites Qwen2.5 Technical Report.

Improving Continual Pre-training Through Seamless Data Packing Qwen2.5 Technical Report

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:04.969013Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24b41f8c-5fc7-4375-9292-71df5dded36e · outbound

This paper cites Investigating Continual Pretraining in Large Language Models: Insights and Implications.

Improving Continual Pre-training Through Seamless Data Packing Investigating Continual Pretraining in Large Language Models: Insights and Implications

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:05.038672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4f43dfeb-6ce1-4d6f-af02-c4c3e77efc9c · outbound

This paper cites online" 'onlinestring :=.

Improving Continual Pre-training Through Seamless Data Packing online" 'onlinestring :=

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:05.101221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 337305d1-9e2f-45ab-8338-bbc4ac70082d · outbound

This paper cites write newline.

Improving Continual Pre-training Through Seamless Data Packing write newline

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-07T13:25:05.152317Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.