Pith. sign in

Paper Citation Record · LEDGER

ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

As of 23 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 9 inbound Pith citation observations for arXiv:2104.07857.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2104.07857 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 9 of 9 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 9 of 9 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-10T21:48:15.231646Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

57
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 47c79d72-47c9-41b2-83e8-d4f6d4285e35 · inbound

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model cites this paper.

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 56

Resolution
verified exact
arxiv_id, observed 2026-05-24T12:14:26.603797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-24T12:10:49.690618Z digest=sha256:4586b3ff0b772a3263539799a932be9afdffd36190b64cd06121e89be31cd056

Observation 5b7311e8-64ae-46d4-93bf-d08657db1649 · inbound

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale cites this paper.

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 77

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T13:35:36.112167Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-05-13T13:35:35.972596Z digest=sha256:a928978519023a0a02fcae2a58c2a85229fda1ea0c87609e84909f3abb2fd8a9

Observation 3ef9ad6c-2754-4681-bc46-3eb659514fe6 · inbound

Practical Design and Benchmarking of Generative AI Applications for Surgical Billing and Coding cites this paper.

Practical Design and Benchmarking of Generative AI Applications for Surgical Billing and Coding ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-10T21:48:15.231646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T21:48:15.231646Z digest=sha256:17535f11ee890b3568c5d6837a30fbe5ffd036a4beee75d358554b5fd688fa67

Observation eac066d1-55ad-4914-9134-18f059fbd4c8 · inbound

Speeding up Model Loading with fastsafetensors cites this paper.

Speeding up Model Loading with fastsafetensors ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T12:58:05.322950Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T12:58:05.322950Z digest=sha256:c2155ad9a12cbe124e16c204feedd5b8cf28d1111b7f7a50081637449c74f9c3

Observation e2b3638e-38a1-4326-946c-6c6f81a290f7 · inbound

Infinite Sampling: Efficient and Stable Grouped RL Training for Large Language Models cites this paper.

Infinite Sampling: Efficient and Stable Grouped RL Training for Large Language Models ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-06T22:01:23.734112Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:01:23.734112Z digest=sha256:61a61f689a17fd8acf0dd727d01742c8fa50d2ee80166182497f0f75f251a46e

Observation c6a546ef-7146-4d16-a77d-769bc003fe8f · inbound

Efficient Training on Multiple Consumer GPUs with RoundPipe cites this paper.

Efficient Training on Multiple Consumer GPUs with RoundPipe ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 42

Resolution
verified exact
arxiv_id, observed 2026-05-12T09:31:26.792934Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-07T10:37:22.251566Z digest=sha256:cea732ed1c8299bd94d7d991e163a9a50fa34add907448a1b2a5964189aeca2b

Observation f9e91246-80d2-4687-afbb-3f511f6ea6a3 · inbound

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training cites this paper.

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 16

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T18:32:42.956504Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-19T18:30:24.657592Z digest=sha256:32970d19c473e6bcbdbed050cb1a1100cae1ce423800c42724a1bfa28ad53d8b

Observation ed54f167-bd48-4bdf-90c2-ab70536557d3 · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 234

Resolution
verified exact
arxiv_id, observed 2026-07-04T11:09:46.154734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-26T08:09:57.542558Z digest=sha256:602485c89c4f3e30474f7f2d90d61edff87d86cec74743a50e06b905cca40f87

Observation 2ab751d5-1005-4adb-8649-1c5012e0d69b · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 234

Resolution
unresolved
no resolver link, observed 2026-08-02T10:27:18.533828Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T10:27:18.533828Z digest=sha256:79193aaa269b3443fbd9c93ddcb45143c3388ea46d3d67e84b0468dae9826ee4