Paper Citation Record · LEDGER

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages

As of 19 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2608.08800.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.08800 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-14T04:29:40.815946Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

verified exact1
verified fuzzy3
unresolved16
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation fdb4dafa-96bb-469e-8247-1361ed9c5ef7 · outbound

This paper cites Choosing Transfer Languages for Cross-Lingual Learning.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Choosing Transfer Languages for Cross-Lingual Learning

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.506023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bd0816e2-6e89-4aa5-b8f1-ff9ad6bd5503 · outbound

This paper cites Trivial Transfer Learning for Low-Resource Neural Machine Translation.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Trivial Transfer Learning for Low-Resource Neural Machine Translation

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.517939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20a7ceb3-ca5a-4dca-ae53-47525b813107 · outbound

This paper cites and Petty, Jackson and Shi, Chuan and Merrill, William and Linzen, Tal.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages and Petty, Jackson and Shi, Chuan and Merrill, William and Linzen, Tal

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.526683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dd7b21a0-6c7e-481f-8050-25be754cf435 · outbound

This paper cites Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.557512Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9229c296-ff7f-4ca1-8ffb-02b03d764ec5 · outbound

This paper cites Pretraining Language Models with L o RA and Artificial Languages.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Pretraining Language Models with L o RA and Artificial Languages

Reference 5

Resolution: verified exact; doi, observed 2026-08-14T04:29:41.094172Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation d8ad28f6-baaf-4bd1-82d9-14134b94d4d3 · outbound

This paper cites Transfer of Structural Knowledge from Synthetic Languages.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Transfer of Structural Knowledge from Synthetic Languages

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.582662Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ff36307a-718b-42a4-97fa-80e81435f081 · outbound

This paper cites FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.593917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c153e173-4770-4c24-9608-08d2a2fd9df8 · outbound

This paper cites The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track , year=

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:29:41.745863Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 53dc627b-6c8a-43c5-b1a7-b7e8077807d5 · outbound

This paper cites O pen S ubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages O pen S ubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.624733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ae7238fc-cb42-4298-9e59-8fc53780acd9 · outbound

This paper cites Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12) , year =.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12) , year =

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.657499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 157ad384-4755-40a5-bb7e-661ee21e81c1 · outbound

This paper cites Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.668879Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6f6ba34c-b5b4-48b3-99f8-3f375b2d00b2 · outbound

This paper cites 2015 , publisher=.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages 2015 , publisher=

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:29:41.597338Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 0fde5a0d-2149-4f0a-910d-3f558465fbfd · outbound

This paper cites The Oxford Handbook of Inflection , publisher =.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages The Oxford Handbook of Inflection , publisher =

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.684973Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7cc3565-a9e1-4a60-b680-d9f0a86ffbc0 · outbound

This paper cites Injecting structural hints: Using language models to study inductive biases in language learning.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Injecting structural hints: Using language models to study inductive biases in language learning

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.689716Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f8a8b146-077d-4c65-9185-34dcfaf9fb04 · outbound

This paper cites The Llama 3 Herd of Models.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages The Llama 3 Herd of Models

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.703620Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1510d855-979f-43b5-a257-1b8b4af6be8f · outbound

This paper cites Gemma 3 Technical Report.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Gemma 3 Technical Report

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.710551Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ec43853a-7522-4439-9f2f-8e4f81e6bbc5 · outbound

This paper cites doi:10.18653/v1/2024.acl-long.44 , booktitle=.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages doi:10.18653/v1/2024.acl-long.44 , booktitle=

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.754750Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4a7f19f2-609f-4cb2-a437-c64a5fc28318 · outbound

This paper cites doi:10.5281/zenodo.12608602 , url =.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages doi:10.5281/zenodo.12608602 , url =

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.780606Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 111cdefd-10fd-4261-a158-9ff3b9534763 · outbound

This paper cites 2023 , organization=.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages 2023 , organization=

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:29:41.517553Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation f3525ef3-a0c2-4ee8-9fe1-f004bef8772d · outbound

This paper cites Training Compute-Optimal Large Language Models.

Instability of LLM Pre-Pretraining: It Doesn't Always Help. An Investigation on Multiple Languages Training Compute-Optimal Large Language Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-14T04:29:40.815946Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.