Pith. sign in

REVIEW 20 cited by

Continual Pre-Training of Large Language Models: How to (re)warm your model?

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2308.04014 v2 pith:KTJGQIU4 submitted 2023-08-08 cs.CL cs.LG

classification cs.CLcs.LG
keywords datamodelsdownstreampre-trainingcontinuallanguagelargeperformance
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

Large language models (LLMs) are routinely pre-trained on billions of tokens, only to restart the process over again once new data becomes available. A much cheaper and more efficient solution would be to enable the continual pre-training of these models, i.e. updating pre-trained models with new data instead of re-training them from scratch. However, the distribution shift induced by novel data typically results in degraded performance on past data. Taking a step towards efficient continual pre-training, in this work, we examine the effect of different warm-up strategies. Our hypothesis is that the learning rate must be re-increased to improve compute efficiency when training on a new dataset. We study the warmup phase of models pre-trained on the Pile (upstream data, 300B tokens) as we continue to pre-train on SlimPajama (downstream data, 297B tokens), following a linear warmup and cosine decay schedule. We conduct all experiments on the Pythia 410M language model architecture and evaluate performance through validation perplexity. We experiment with different pre-training checkpoints, various maximum learning rates, and various warmup lengths. Our results show that while rewarming models first increases the loss on upstream and downstream data, in the longer run it improves the downstream performance, outperforming models trained from scratch$\unicode{x2013}$even for a large downstream dataset.

Discussion (0). Sign in to comment.

Forward citations

Cited by 20 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts

    cs.LG 2026-04 unverdicted novelty 7.0 of 10

    Expert upcycling duplicates experts in an existing MoE checkpoint and continues pre-training to match fixed-size baseline performance with 32% less compute.

  2. WSqD: A Horizon-Free Learning Rate Schedule for Large Model Training

    cs.LG 2026-07 conditional novelty 6.0 of 10

    WSqD uses a horizon-independent shifted inverse-square-root base plus linear cooldown to get optimal last-iterate rates in convex stochastic optimization and match or beat tuned WSD on LLM pretraining with one reused ...

  3. How Post-Training Shapes Biological Reasoning Models

    cs.LG 2026-06 unverdicted novelty 6.0 of 10

    Post-training stages reshape generalization in biological reasoning models distinctly: CPT aligns with biological language, SFT boosts ID performance but causes OOD to peak early and decline, while RL on strong SFT ch...

  4. Predictable Scaling Laws of Optimal Hyperparameters for LLM Continued Pre-training

    cs.CL 2026-06 unverdicted novelty 6.0 of 10

    Optimal hyperparameters for LLM continued pre-training follow predictable scaling laws derived from proxy models, enabling a two-stage framework that predicts settings from compute budget and checkpoint state to reduc...

  5. ZAYA1-8B Technical Report

    cs.AI 2026-05 unverdicted novelty 6.0 of 10

    ZAYA1-8B is a reasoning MoE model with 700M active parameters that matches larger models on math and coding benchmarks and reaches 91.9% on AIME'25 via Markovian RSA test-time compute.

  6. Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts

    cs.LG 2026-04 unverdicted novelty 6.0 of 10

    Expert upcycling expands MoE models by duplicating experts and continuing pre-training, matching baseline performance while saving 32% GPU hours in 7B-13B experiments.

  7. From $P(y|x)$ to $P(y)$: Investigating Reinforcement Learning in Pre-train Space

    cs.LG 2026-04 unverdicted novelty 6.0 of 10

    PreRL applies reward-driven updates to P(y) in pre-train space, uses Negative Sample Reinforcement to prune bad reasoning paths and boost reflection, and combines with standard RL in Dual Space RL to outperform baseli...

  8. Llemma: An Open Language Model For Mathematics

    cs.CL 2023-10 unverdicted novelty 6.0 of 10

    Continued pretraining of Code Llama on Proof-Pile-2 yields Llemma, an open math-specialized LLM that beats known open base models on MATH and supports tool use plus formal proving out of the box.

  9. Scaling Point-in-Time Language Models

    cs.CL 2026-04 conditional novelty 5.5 of 10

    Scaling point-in-time decoder-only LMs to 4B parameters on 1T chronologically filtered FineWeb tokens largely closes the quality gap to unrestricted open models while preserving temporal validity.

  10. MedLLM: An Open Medical Language Model at the Sub-Billion Scale

    cs.AI 2026-07 reject novelty 5.0 of 10

    A 100M-parameter model, MedLLM, is reported to beat 7B medical baselines on MedMCQA and MMLU while staying near the floor on MedQA, but the claimed 'within 2.9pp of a medically adapted 7B' result has no matching row i...

  11. ZUNA1.1: A more flexible EEG foundation model for Denoising and Super-resolution

    cs.LG 2026-07 conditional novelty 5.0 of 10

    ZUNA1.1, an open-source 380M EEG diffusion autoencoder, reconstructs variable-length, flexibly masked EEG at least as well as its predecessor and far better than spherical spline interpolation.

  12. Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay

    cs.LG 2026-05 unverdicted novelty 5.0 of 10

    Self-generated replay from language models nearly eliminates catastrophic forgetting during finetuning except when models are pretrained close to saturation.

  13. Scaling Point-in-Time Language Models

    cs.CL 2026-04 conditional novelty 5.0 of 10

    Scaling point-in-time LLMs to 4B parameters and 1T temporally filtered tokens narrows the gap to unrestricted models to about 8–11 average points and yields positive out-of-sample Sharpe ratios from news embeddings.

  14. Router Upcycling: Leveraging Mixture-of-Routers in Mixture-of-Experts Upcycling

    cs.CL 2025-08 conditional novelty 5.0 of 10

    Router Upcycling initializes MoE routers from the dense model's attention heads, achieving about 2% higher average zero-shot accuracy than vanilla upcycling on small Qwen 8x0.5B models.

  15. ZONOS2 Technical Report

    cs.SD 2026-06 unverdicted novelty 4.0 of 10

    ZONOS2 8B is a scaled MoE TTS model with 900M active parameters trained on 6M hours of data that reports competitive SOTA results on naturalness, speaker similarity, WER, and a new ZTTS1-Eval benchmark while releasing...

  16. VectraYX-Nano: A 42M-Parameter Spanish Cybersecurity Language Model with Curriculum Learning and Native Tool Use

    cs.CL 2026-05 unverdicted novelty 4.0 of 10

    VectraYX-Nano is a 42M-parameter Spanish cybersecurity LLM trained with curriculum learning and native MCP tool use, achieving 0.78 conversational gate and improved tool selection with denser data.

  17. VectraYX-Nano: A 42M-Parameter Spanish Cybersecurity Language Model with Curriculum Learning and Native Tool Use

    cs.CL 2026-05 unverdicted novelty 4.0 of 10

    Trains a 42M-parameter Spanish cybersecurity LLM from scratch with curriculum phases and achieves 0.23 tool-selection accuracy after SFT mixture rebalancing to 1:21 tool-use ratio.

  18. VectraYX-Nano: A 42M-Parameter Spanish Cybersecurity Language Model with Curriculum Learning and Native Tool Use

    cs.CL 2026-05 unverdicted novelty 4.0 of 10

    A 42M-parameter Spanish cybersecurity LLM trained with curriculum learning and MCP tool use, reporting benchmark scores from corpus ablations and SFT rebalancing.

  19. ZONOS2 Technical Report

    cs.SD 2026-06 unverdicted novelty 3.0 of 10

    ZONOS2 8B scales a prior TTS system to 8B parameters with MoE architecture and 6M hours of data, reporting competitive benchmark performance on naturalness and speaker similarity while releasing weights.

  20. A Survey on Foundation Models for Personalized Federated Intelligence

    cs.AI 2025-05 unverdicted novelty 3.0 of 10

    The survey introduces personalized federated intelligence (PFI) as a framework integrating federated learning and foundation models to support privacy-aware personalization of AI models.

Pith tools