Paper Citation Record · LEDGER

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training

As of 12 August 2026, this Paper Citation Record lists 42 of 42 outbound references and 0 inbound Pith citation observations for arXiv:2507.19845.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.19845 v1

Coverage vector

measured 42 of 42 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T14:01:43.396738Z

measured 42 of 42 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

42 of 42 outbound references displayed

verified exact0
verified fuzzy29
unresolved13
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation ff1925d7-40c7-4c6f-b4bb-df4615080ae4 · outbound

This paper cites Attention is all you need.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Attention is all you need

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:39.559642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f9b86a61-9348-4143-aefd-52c6324907e5 · outbound

This paper cites Route sparse autoencoder to interpret large language models, 2025.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Route sparse autoencoder to interpret large language models, 2025

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.984052Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 5a2429ba-70c8-4444-b997-dc1a04cf3227 · outbound

This paper cites Interpreting learned feedback patterns in large language models, 2024.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Interpreting learned feedback patterns in large language models, 2024

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.969779Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 333a933b-5304-4ace-a646-81d366802d4d · outbound

This paper cites Sparse autoencoders find highly interpretable features in language models, 2023.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Sparse autoencoders find highly interpretable features in language models, 2023

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:39.816521Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cb026c37-87c6-4cad-b799-74899eab1997 · outbound

This paper cites Tracr: Compiled transformers as a laboratory for interpretability, 2023.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Tracr: Compiled transformers as a laboratory for interpretability, 2023

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.945562Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation ec6fb7e6-1d9b-416b-bd84-dd4d2fb33986 · outbound

This paper cites Zimmermann, David Klindt, and Wieland Brendel.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Zimmermann, David Klindt, and Wieland Brendel

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.931252Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 92af1654-07de-4367-a6b4-af36556f750a · outbound

This paper cites DeepSeek-V3 Technical Report.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training DeepSeek-V3 Technical Report

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:40.184335Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 68cecba5-44f4-490b-94db-8929bdc64130 · outbound

This paper cites The Llama 3 Herd of Models.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training The Llama 3 Herd of Models

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:40.340536Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 441abff4-518f-47f4-adde-dece146ca099 · outbound

This paper cites Qwen3 Technical Report.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Qwen3 Technical Report

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:40.462652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82ec489f-a863-4312-b85c-fe96127430d9 · outbound

This paper cites Visualizing Attention in Transformer-Based Language Representation Models.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Visualizing Attention in Transformer-Based Language Representation Models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:40.587293Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3f287fc3-5185-4bd0-b65b-e64b5327549b · outbound

This paper cites an unresolved cited work.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Unresolved cited work

Reference 11

Resolution: unresolved; raw_fallback, observed 2026-08-06T14:01:46.917273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 74cba2ec-dce6-4bed-bd00-2639b8036c5f · outbound

This paper cites Developments in MLflow: A system to accelerate the machine learning lifecycle.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Developments in MLflow: A system to accelerate the machine learning lifecycle

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.894388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 0f683cbd-b2f8-4c4c-b52b-f266749e94d4 · outbound

This paper cites Efficient large-scale language model training on gpu clusters using megatron-lm.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Efficient large-scale language model training on gpu clusters using megatron-lm

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.879765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 0aee5559-aef9-42ff-bb2c-c874c06b4978 · outbound

This paper cites Reducing activation recomputation in large transformer models.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Reducing activation recomputation in large transformer models

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:41.151142Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a109fa2d-b94b-4970-907e-b0af63d062de · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:41.217172Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6b75a2a9-0015-467d-9fa1-f2d45e80d286 · outbound

This paper cites Scaling distributed machine learning with the parameter server.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Scaling distributed machine learning with the parameter server

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.856430Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 6150a5a3-7d91-4ef6-b437-d715e424af2e · outbound

This paper cites Bandwidth optimal all-reduce algorithms for clusters of workstations.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Bandwidth optimal all-reduce algorithms for clusters of workstations

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.843044Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation d670b2b2-2db2-49f3-9895-b89b57899423 · outbound

This paper cites Gpipe: Efficient training of giant neural networks using pipeline parallelism.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Gpipe: Efficient training of giant neural networks using pipeline parallelism

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:41.437954Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 36555eb7-47b1-4ef5-a422-6d9be5b26522 · outbound

This paper cites Pipedream: Generalized pipeline parallelism for dnn training.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Pipedream: Generalized pipeline parallelism for dnn training

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:41.482246Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1354c924-88cd-4093-a6f2-613c17f0e5cf · outbound

This paper cites Memory-efficient pipeline- parallel dnn training.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Memory-efficient pipeline- parallel dnn training

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.809838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 21f6cffb-eff5-4679-82a3-d08e5ba1d719 · outbound

This paper cites Deepspeed, 2024.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Deepspeed, 2024

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.796008Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation cf36bcac-ac4a-4a0e-ad23-85d8dce1308d · outbound

This paper cites Zero-offload : Democratizing billion-scale model training.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Zero-offload : Democratizing billion-scale model training

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.781892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 93504845-a558-4545-a527-62a941a443c7 · outbound

This paper cites PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:41.855087Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ed74d2bb-3e91-4260-816e-80a5024568b2 · outbound

This paper cites Explainability for large language models: A survey.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Explainability for large language models: A survey

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.767182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation ceaab547-4e42-4b29-9bc7-9a9e61a1e1b2 · outbound

This paper cites From understanding to utilization: A survey on explainability for large language models.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training From understanding to utilization: A survey on explainability for large language models

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.751741Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 7010d1ec-8760-4698-aba3-48078e09b0af · outbound

This paper cites A gentle introduction to mechanistic interpretability of neural networks.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training A gentle introduction to mechanistic interpretability of neural networks

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.737650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 43547ed2-3779-4be1-a8af-a01560d2f2f5 · outbound

This paper cites Locating and editing factual associations in gpt.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Locating and editing factual associations in gpt

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.633248Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 2d6f0289-77da-4584-9d94-be27a7c6c358 · outbound

This paper cites Mass editing memory in a transformer.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Mass editing memory in a transformer

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.375887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation f730ae48-5cac-4f9c-bc79-316a5f5afa7d · outbound

This paper cites Advances of pipeline model parallelism for deep learning training: An overview.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Advances of pipeline model parallelism for deep learning training: An overview

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:46.105517Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 980faaf9-7684-4298-9263-9c192427a24f · outbound

This paper cites Dawnpiper: A memory-scalable pipeline parallel training framework.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Dawnpiper: A memory-scalable pipeline parallel training framework

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:45.900742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 38bb6fd1-6f77-4ab0-b3cf-6456c0fb6560 · outbound

This paper cites Zero bubble (almost) pipeline parallelism.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Zero bubble (almost) pipeline parallelism

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:45.613957Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 415d253a-784a-4d0a-a294-75c0aa9455e3 · outbound

This paper cites Understanding stragglers in large model training using what-if analysis.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Understanding stragglers in large model training using what-if analysis

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:45.354605Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 1ee9aca3-7f24-412a-85ef-1c054c85e8fe · outbound

This paper cites DPro-SM: A distributed framework for proactive straggler mitigation using LSTM.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training DPro-SM: A distributed framework for proactive straggler mitigation using LSTM

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:45.107771Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 44d3816a-5648-4261-95b9-7db5fcf7a0b4 · outbound

This paper cites Greyhound: Hunting fail-slows in hybrid-parallel training at scale.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Greyhound: Hunting fail-slows in hybrid-parallel training at scale

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:44.913261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 7cba1e19-934a-4b22-b3cd-1a350b27b51b · outbound

This paper cites FlashFlex: Accommodating large language model training over heterogeneous environment.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training FlashFlex: Accommodating large language model training over heterogeneous environment

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:44.742355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 64aa6532-7026-45b8-ae6f-0f38aea52f27 · outbound

This paper cites NVIDIA CUDA gets RISC-V support.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training NVIDIA CUDA gets RISC-V support

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:44.549284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 8e6928b4-5309-472e-95e5-7b09c541a9b9 · outbound

This paper cites Varuna: scalable, low-cost training of massive deep learning models.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Varuna: scalable, low-cost training of massive deep learning models

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:44.365327Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation fe38a153-6f27-458f-afeb-600c3d8e9f7f · outbound

This paper cites NVIDIA Data Center GPU Manager (DCGM).

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training NVIDIA Data Center GPU Manager (DCGM)

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:44.183639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation b66d6968-d2d5-4781-a9e5-8a1afe9d455d · outbound

This paper cites CUDA Toolkit Documentation.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training CUDA Toolkit Documentation

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:43.999834Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation d34332ad-b43f-4f4b-a5f2-9b4d18b888e2 · outbound

This paper cites Chrome Tracing.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Chrome Tracing

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:43.803278Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 950fd966-35d4-4c16-a301-8f1e219f3cd7 · outbound

This paper cites Perfetto Open-Source Tracing Project.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Perfetto Open-Source Tracing Project

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T14:01:43.682854Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

Observation 1e755396-cea0-4889-b480-2a078e60b8ec · outbound

This paper cites an unresolved cited work.

MegatronApp: Efficient and Comprehensive Management on Distributed LLM Training Unresolved cited work

Reference 2015

Resolution: unresolved; no resolver link, observed 2026-08-06T14:01:40.874247Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.