Paper Citation Record · LEDGER

Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

As of 5 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 34 inbound Pith citation observations for arXiv:2104.04473.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2104.04473 v5

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 34 of 34 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00

measured 34 of 34 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T11:25:09.562026Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

9
pith, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation a4d62a99-e85b-4e0d-86d5-17278d726ffe · inbound

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model cites this paper.

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 43

Resolution: verified exact; arxiv_id, observed 2026-05-24T12:14:26.541851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 50c00f4f-b34c-4082-acab-2ff8b53dd1d2 · inbound

OPT: Open Pre-trained Transformer Language Models cites this paper.

OPT: Open Pre-trained Transformer Language Models Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 142

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T20:53:17.533584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 98915eea-eaf6-4490-9f89-fa2b7b9db928 · inbound

SpikingBrain: Spiking Brain-inspired Large Models cites this paper.

SpikingBrain: Spiking Brain-inspired Large Models Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-18T18:51:45.811840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation fdb78c4e-ce1a-4b43-aee2-89eaf78d9c06 · inbound

Towards EnergyGPT: A Large Language Model Specialized for the Energy Sector cites this paper.

Towards EnergyGPT: A Large Language Model Specialized for the Energy Sector Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 60

Resolution: verified exact; arxiv_id, observed 2026-05-18T17:42:47.536706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5016bb78-fabd-40f9-90ce-84c305794c98 · inbound

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining cites this paper.

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 15

Resolution: metadata mismatch; arxiv_id, observed 2026-05-17T04:49:03.022290Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 24b707cb-bacc-4ff0-948d-eaa90040a26f · inbound

Rethinking Expert Trajectory Utilization in LLM Post-training for Mathematical Reasoning cites this paper.

Rethinking Expert Trajectory Utilization in LLM Post-training for Mathematical Reasoning Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-16T22:43:37.893546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 19c9e4ea-19e8-4fd7-82ab-82d278e94d87 · inbound

Revisiting Training Scale: An Empirical Study of Token Count, Power Consumption, and Parameter Efficiency cites this paper.

Revisiting Training Scale: An Empirical Study of Token Count, Power Consumption, and Parameter Efficiency Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-03T11:25:09.562026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 328733c0-12be-44c1-8352-58b97e7d75af · inbound

Kimi K2.5: Visual Agentic Intelligence cites this paper.

Kimi K2.5: Visual Agentic Intelligence Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 43

Resolution: verified exact; arxiv_id, observed 2026-05-10T16:09:05.345041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 177b40ef-d995-4946-a80f-645b9db7e617 · inbound

Attention Residuals cites this paper.

Attention Residuals Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 34

Resolution: verified exact; arxiv_id, observed 2026-05-21T06:39:04.522153Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c9817349-2284-48aa-8094-16363d79dabe · inbound

AEGIS: Scaling Long-Sequence Homomorphic Encrypted Transformer Inference via Hybrid Parallelism on Multi-GPU Systems cites this paper.

AEGIS: Scaling Long-Sequence Homomorphic Encrypted Transformer Inference via Hybrid Parallelism on Multi-GPU Systems Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 51

Resolution: verified exact; arxiv_id, observed 2026-05-13T19:23:09.283474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 6a0912e7-1778-41aa-9a95-863b705e390c · inbound

An Engineering Journey Training Large Language Models at Scale on Alps: The Apertus Experience cites this paper.

An Engineering Journey Training Large Language Models at Scale on Alps: The Apertus Experience Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-05-10T14:20:30.878284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation b02ba0ef-36db-49ff-9907-d9d5d8aa0421 · inbound

Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels cites this paper.

Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-05-10T10:24:21.492412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation b98fd996-021b-4bf4-bd1b-e32939204f3b · inbound

GPUOS: A GPU Operating System Primitive for Transparent Operation Fusion cites this paper.

GPUOS: A GPU Operating System Primitive for Transparent Operation Fusion Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-05-11T11:51:04.200107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation fbf8fc09-41b9-4bdb-b3b7-64885625d174 · inbound

Efficient Training on Multiple Consumer GPUs with RoundPipe cites this paper.

Efficient Training on Multiple Consumer GPUs with RoundPipe Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 35

Resolution: verified exact; arxiv_id, observed 2026-05-12T09:31:26.784462Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4459bbc7-997e-4ae8-bc91-8ddb8ad82895 · inbound

A Scalable Recipe on SuperMUC-NG Phase 2: Efficient Large-Scale Training of Language Models cites this paper.

A Scalable Recipe on SuperMUC-NG Phase 2: Efficient Large-Scale Training of Language Models Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 16

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T03:45:56.331268Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation d8715644-38f9-4b6f-9f37-30e957cda438 · inbound

Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers cites this paper.

Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 26

Resolution: verified exact; arxiv_id, observed 2026-05-12T06:41:45.669017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5e29785d-d1b4-451b-88e8-0ea4b476cde0 · inbound

MinT: Managed Infrastructure for Training and Serving Millions of LLMs cites this paper.

MinT: Managed Infrastructure for Training and Serving Millions of LLMs Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:27:51.896687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 66d0774e-14e5-4333-ad20-0313dfe62708 · inbound

MinT: Managed Infrastructure for Training and Serving Millions of LLMs cites this paper.

MinT: Managed Infrastructure for Training and Serving Millions of LLMs Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-06-30T22:05:06.246888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 98a325aa-8eea-4233-abb5-1b7f161c9428 · inbound

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference cites this paper.

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 10

Resolution: metadata mismatch; arxiv_id, observed 2026-05-20T14:13:21.202970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 74ea8c6e-298e-4381-a6e7-301a64b72879 · inbound

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference cites this paper.

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 16

Resolution: verified exact; arxiv_id, observed 2026-05-21T08:59:55.795270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 79497a54-12f9-423d-aafb-370042858c82 · inbound

A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability cites this paper.

A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 33

Resolution: verified exact; arxiv_id, observed 2026-05-20T07:38:09.493332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 12c7c42b-e7ee-4c9e-a26f-e5612c9b589e · inbound

Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks cites this paper.

Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-06-30T15:44:48.308088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 18dd1c7d-1d54-4fb3-b41d-d0ad1f22525a · inbound

Heterogeneous Parallelism for Multimodal Large Language Model Training cites this paper.

Heterogeneous Parallelism for Multimodal Large Language Model Training Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-06-29T18:43:50.412459Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 702f9e44-561d-495f-a5ef-ae30dc9bc281 · inbound

MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention cites this paper.

MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 50

Resolution: verified exact; arxiv_id, observed 2026-07-01T22:26:17.872984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5c6e3757-cf93-446d-827b-e7eeb1a5facb · inbound

Model Multiplicity for Adversarial Detection in Small Language Model Training on Edge Devices cites this paper.

Model Multiplicity for Adversarial Detection in Small Language Model Training on Edge Devices Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 17

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T19:37:19.322887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8ac83b28-42d8-4410-8f26-1dd54aa5ebbe · inbound

Piper: A Programmable Distributed Training System cites this paper.

Piper: A Programmable Distributed Training System Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 30

Resolution: verified exact; arxiv_id, observed 2026-07-03T07:57:44.655438Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 132e3e92-7590-4d9e-87c2-8672827fad05 · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 225

Resolution: verified exact; arxiv_id, observed 2026-07-04T11:09:46.461495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation db29d1e9-7eb4-4784-8506-b0ee07621a42 · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 211

Resolution: unresolved; no resolver link, observed 2026-08-02T10:27:18.508664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 78b96fde-1b39-415a-b5e3-11a9ee3918da · inbound

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint cites this paper.

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-07-03T17:28:43.916831Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation e857b2bb-5386-442e-8cc5-6b2d1d92bfee · inbound

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint cites this paper.

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 4

Resolution: unresolved; no resolver link, observed 2026-07-12T08:40:29.554554Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e919841b-30d3-4e66-a2d1-e594d06b6753 · inbound

Design-CP: Context Parallelism for Design of Protein Nanoparticles cites this paper.

Design-CP: Context Parallelism for Design of Protein Nanoparticles Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 75

Resolution: unresolved; no resolver link, observed 2026-07-12T02:29:52.764344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7ed52c58-f009-466d-870c-16cd34446578 · inbound

GIFT: Geometry-Informed Low-precision Gradient Communication for LLM Pretraining cites this paper.

GIFT: Geometry-Informed Low-precision Gradient Communication for LLM Pretraining Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 14

Resolution: verified exact; local_arxiv, observed 2026-07-09T09:16:06.525993Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 00d01956-3547-4166-88a1-c427c5c4440e · inbound

LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget cites this paper.

LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-02T00:41:45.468565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73494bae-8a1d-4c9f-a9ac-3a3c3d90d1a0 · inbound

A Training-Memory Regression in MLA Sequence Parallelism: Why Megatron-Core Forbids Absorption, and LAGA -- a Communication-Efficient Fix cites this paper.

A Training-Memory Regression in MLA Sequence Parallelism: Why Megatron-Core Forbids Absorption, and LAGA -- a Communication-Efficient Fix Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-01T17:32:37.511773Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.