Pith. sign in

Paper Citation Record · LEDGER

veScale-FSDP: Flexible and High-Performance FSDP at Scale

As of 3 August 2026, this Paper Citation Record lists 36 of 36 outbound references and 1 inbound Pith citation observation for arXiv:2602.22437.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2602.22437 v3

Coverage vector

measured 36 of 36 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-15T19:03:22.142671Z

measured 37 of 37 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-03T06:30:56.289259+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T06:45:15.274057Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

36 of 36 outbound references displayed

  • verified exact15
  • verified fuzzy20
  • unresolved1
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 5998d2c2-4a94-4a12-b8ed-f846976d59bf · outbound

This paper cites gpt-oss-120b & gpt-oss-20b Model Card.

veScale-FSDP: Flexible and High-Performance FSDP at Scale gpt-oss-120b & gpt-oss-20b Model Card

Reference 1

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.812760Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:2064ef4ecfb3cb2bc670ff27f15b060edc2327dad26ca611fb4eec726ffd08a6

Observation a49cee27-c101-43a0-af10-591238e2d99c · outbound

This paper cites 8-bit optimizers via block-wise quantization.

veScale-FSDP: Flexible and High-Performance FSDP at Scale 8-bit optimizers via block-wise quantization

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.286825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:6951096f90900ccc53599717282ed86cbc9d8b93dbd7fe2eed8e2cf58417420d

Observation 6519037e-3e60-49cd-a62b-77b254e4ad24 · outbound

This paper cites The llama 3 herd of models.arXiv e-prints, pages arXiv–2407.

veScale-FSDP: Flexible and High-Performance FSDP at Scale The llama 3 herd of models.arXiv e-prints, pages arXiv–2407

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.267671Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:49b8a39a0b880519ac39b8cf088d6647bee7050c53f5489b52a7317dd12e8b26

Observation e231b96b-9de7-4a3e-aa13-bf630c1f8a40 · outbound

This paper cites an unresolved cited work.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-05-15T19:10:17.272353Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:7f6913666365932945a6e9c7d3e51d834e4a1ba2bc959d745e1e454749425f55

Observation 027506bc-fcbf-4a85-9934-65cf7e8c92a4 · outbound

This paper cites [rfc] per-parameter-sharding fsdp.

veScale-FSDP: Flexible and High-Performance FSDP at Scale [rfc] per-parameter-sharding fsdp

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.308513Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:d4899a4e07d1ca8a2c1df424ce1806c61bda7a6b54cd919714a7cf27fd1e9975

Observation 80ef9150-478c-4eb7-ae22-8ffbecd493cf · outbound

This paper cites Shampoo: Preconditioned stochastic tensor optimization.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Shampoo: Preconditioned stochastic tensor optimization

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.262636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:a4dadeca3603b1278a62d149f7acbfa8ca925c230cf792a27900e702d26e1c9f

Observation 0cf3f73e-cd5c-4584-9072-935e0fd3cec6 · outbound

This paper cites Deepspeed is slower than fsdp.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Deepspeed is slower than fsdp

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.312721Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:01ba8c2cadb037b96c9390abcf7c5d5f45457d3e8761b14a4b25e88393be1f68

Observation a7d68984-808a-41bc-8204-96cb476f1e50 · outbound

This paper cites In 21st USENIX Symposium on NetworkedSystems Design and Implementation (NSDI 24), pages 745–760.

veScale-FSDP: Flexible and High-Performance FSDP at Scale In 21st USENIX Symposium on NetworkedSystems Design and Implementation (NSDI 24), pages 745–760

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.282568Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:732159fa9638cbe96d3de87b3f30dd3d15f817e84c77adab403b2aa84c4c45bd

Observation e2a1e1be-94fe-4a22-8e64-7c4594f490e6 · outbound

This paper cites Muon: An optimizer for hidden layers in neural networks.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Muon: An optimizer for hidden layers in neural networks

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.258610Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:e210a232b1b3d26f6beec2c94693d0689f2eb0c123705425f38e6c263f618655

Observation 9ca1e60a-00ac-4367-b35f-fe4c0874a85e · outbound

This paper cites Scaling Laws for Neural Language Models.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Scaling Laws for Neural Language Models

Reference 10

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.818563Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:c45d80bf8c3496d5157aa33284b200a661b59ecbbaf5e543b26e83d8455f94d1

Observation 1118bdd3-03a1-4a75-ac2e-742e6525213d · outbound

This paper cites GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding.

veScale-FSDP: Flexible and High-Performance FSDP at Scale GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.828498Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:d9ca9f699c802ff5cbd8df7dce44f16685c159330ed8382000a02516fa8ec840

Observation d5ac6670-8585-460d-9ea8-314d3bfbf209 · outbound

This paper cites PyTorch Distributed: Experiences on Accelerating Data Parallel Training.

veScale-FSDP: Flexible and High-Performance FSDP at Scale PyTorch Distributed: Experiences on Accelerating Data Parallel Training

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-15T19:06:30.792076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:060b553bfe6bee6e03a71578c834c61b1e49ee1aaa07c0afb0947c0fbc3d7a88

Observation 73653535-1729-4a50-8806-38b7e51d874e · outbound

This paper cites veScale: Consistent and Efficient Tensor Programming with Eager-Mode SPMD.

veScale-FSDP: Flexible and High-Performance FSDP at Scale veScale: Consistent and Efficient Tensor Programming with Eager-Mode SPMD

Reference 13

Resolution
verified exact
arxiv_id, observed 2026-05-15T19:06:30.797758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:c9a0f03212ab76c5ad3f92db11303f6d5d63f0a490ceae2b6600a6636f9fae21

Observation 0d16e34b-b1cc-43ed-950d-36234cd3badf · outbound

This paper cites DeepSeek-V3 Technical Report.

veScale-FSDP: Flexible and High-Performance FSDP at Scale DeepSeek-V3 Technical Report

Reference 14

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.802475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:774982f4b02e1a65a71cf4662566777faca3e4de052e38ec1ece96451b3dbf73

Observation 8779bd6b-f133-47e5-8b1c-001139cddd9e · outbound

This paper cites VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo.

veScale-FSDP: Flexible and High-Performance FSDP at Scale VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-15T19:06:30.840282Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:f4336c3ab92224722f56f27cd795410359b77c249f99414fa9481129b8812663

Observation f1f0ee44-af00-4279-ba8a-33ae9f9017d2 · outbound

This paper cites Mcore custom fully sharded data parallel (fsdp).

veScale-FSDP: Flexible and High-Performance FSDP at Scale Mcore custom fully sharded data parallel (fsdp)

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.304265Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:60419c6d7dc1cda9ed9d4589c4bdf50ea96bf3e9cf0902ae996ca01426deccb1

Observation 6ff394d9-9f9e-45af-94ce-390bf4f878ba · outbound

This paper cites Regarding the allgather bandwidth with different byte alignment under different protocols.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Regarding the allgather bandwidth with different byte alignment under different protocols

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.236415Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:151fad1713cc74ed7fc848b52906bfb735889bb6267a3d5ab12d11d5d34d615e

Observation 656b1bf8-bb2b-4397-853b-122cabb0ded3 · outbound

This paper cites Nccl: Collective operations.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Nccl: Collective operations

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.246851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:b2ed00c77ab452a4b1ac16e93cdd134b83163814838aa15d5e7caaa284aa8537

Observation ed1c5ddd-fc0a-4d8e-932c-0a156925cbe5 · outbound

This paper cites Fully sharded data parallel (fsdp2).

veScale-FSDP: Flexible and High-Performance FSDP at Scale Fully sharded data parallel (fsdp2)

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.316929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:c171637c2857458e122206a5274278c618df5b31eca0b5219950cd3fc8027e4d

Observation 46177dfc-ea04-4159-b6ff-5a5227a99fed · outbound

This paper cites Pytorch jaggedtensor.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Pytorch jaggedtensor

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.296019Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:3f4d9bc3fa0406598b3bbc6f662a4688075e140e5976ccb8472c24b5c6d91705

Observation a79305f6-4403-4fe4-a8ab-600b7189a206 · outbound

This paper cites Pytorch nestedtensor.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Pytorch nestedtensor

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.257243Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:eb7fc8426ca515c87eb7fabeaed3cad2861393d4017af30e9190a79c5fde0735

Observation 6789fd79-6ad8-4de2-8c4d-f8189dd999da · outbound

This paper cites Distributed checkpoint.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Distributed checkpoint

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.331374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:84f7c59c39d4d27d583b6055eccd8537ba841d4194b05fad39f9249392b567f1

Observation 44f340a4-47b8-4655-956e-4f79ac928450 · outbound

This paper cites Meta pytorch team 2026 h1 roadmaps.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Meta pytorch team 2026 h1 roadmaps

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.251837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:20a4397e9373e0fe517d79222b1fe53a205e2b03eec5688202ffa325254976b1

Observation 770a8be2-be77-4dc2-8dff-2d75c04f6e9c · outbound

This paper cites Zero: Memory optimizations toward training trillion parameter models.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Zero: Memory optimizations toward training trillion parameter models

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.276884Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:6bdca4291e47f331ca778b218b03d9295a45b415fdde082c9cc1ab87203c18c9

Observation dd8a1d3e-c76f-45b2-ba2d-8ed17c7c3eea · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 25

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.807753Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:7d7bc79a7e63ecac9ab7dcf8b129e335807c6887193c9dd3f293e91067be93ee

Observation 50005be3-08b2-4d3c-8d04-6b26200316c7 · outbound

This paper cites Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

Reference 26

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.823510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:822cec3d9e958448b608a69bab7db48a33350fcb918eb49829b4ea8281288369

Observation 0bc41cea-3580-433e-862e-d6fbef769fcd · outbound

This paper cites Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Reference 27

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.868363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:1ba23f518dae4b646c52cd2a8b6ec7ed945f21a1636b16129cccb426cb540306

Observation fc522266-a8f0-40fa-a53c-189dffcd370e · outbound

This paper cites Kimi K2: Open Agentic Intelligence.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Kimi K2: Open Agentic Intelligence

Reference 28

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.862712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:6d909c2b56a76e020a6ef2b3d5df2d1db37d554789610a8ffcf0fa148bf0644e

Observation 9abdcc9b-9db2-427a-9105-b1d3b1c0b6ca · outbound

This paper cites Tensorflow ragged tensors.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Tensorflow ragged tensors

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.321010Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:b19fcb509d2e15f696889ff39a8c4f85d05c2849f7c37e56871bd397b59da9ea

Observation acfc63f7-2a1a-4ece-bc77-1d29cebe501e · outbound

This paper cites PyTorch DTensor (Distributed Tensor).https://pytorch.org/docs/stable/distributed.

veScale-FSDP: Flexible and High-Performance FSDP at Scale PyTorch DTensor (Distributed Tensor).https://pytorch.org/docs/stable/distributed

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.327775Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:8ed29083a876a7a52b0b609543541a29877892a28b2f766281c21e9a0697ff8a

Observation eae161c7-baa0-42d0-bf11-6d220841f47d · outbound

This paper cites Fantastic Pretraining Optimizers and Where to Find Them.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Fantastic Pretraining Optimizers and Where to Find Them

Reference 31

Resolution
verified exact
arxiv_id, observed 2026-05-15T19:06:30.851781Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:85e199665937ec1ea0c3ed8afedeec6cb5101adea00f5573f196553697d94ce6

Observation edf0d5a8-2a2d-444d-bbdd-98eb02feb5c7 · outbound

This paper cites Terabyte-Scale Analytics in the Blink of an Eye.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Terabyte-Scale Analytics in the Blink of an Eye

Reference 32

Resolution
verified exact
arxiv_id, observed 2026-05-15T19:06:30.857247Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:c6e070385554a0cef1468eca5b38e48978d255aa98928bdbf8d6f8aa5e77a2d0

Observation 5765d192-40fc-4c02-b4af-24b1d691d513 · outbound

This paper cites FSDP & CUDACachingAllocator.

veScale-FSDP: Flexible and High-Performance FSDP at Scale FSDP & CUDACachingAllocator

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.291619Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:259877adc1c264568ca219326b9aa0a197f987000418676fca4543595c2225d8

Observation ebacae73-2268-49af-95bf-8e16d75a85ff · outbound

This paper cites GSPMD: General and Scalable Parallelization for ML Computation Graphs.

veScale-FSDP: Flexible and High-Performance FSDP at Scale GSPMD: General and Scalable Parallelization for ML Computation Graphs

Reference 34

Resolution
verified exact
arxiv_id, observed 2026-05-18T12:36:36.562059Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:cef73661d8bc782775aab2406b458ddde2b3a4f8bf37d82082b52797ecb689e7

Observation e8b2ffe0-b410-4f20-a2d0-d32ae53856af · outbound

This paper cites PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

veScale-FSDP: Flexible and High-Performance FSDP at Scale PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-05-15T19:06:30.833896Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:f7063b897d34eb04427bc4d58297758dbee0e7f93b5dc93adf75a61a75ccf9c3

Observation 96a6dd7f-9eb4-4b6a-ac64-b70aeb3e1513 · outbound

This paper cites Fsdp1 post backward reduce.

veScale-FSDP: Flexible and High-Performance FSDP at Scale Fsdp1 post backward reduce

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-05-15T19:10:17.300047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T19:03:22.142671Z digest=sha256:aff99a74f2dc689a4d45bf2306a4ff1650a7520f48bc8b6f092c6491744ae6b3

Pith citing papers

Observation afdba9c2-f340-4d9f-8127-a4445be7afed · inbound

SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales cites this paper.

SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales veScale-FSDP: Flexible and High-Performance FSDP at Scale

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-02T06:45:15.274057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T06:45:15.274057Z digest=sha256:9cd5048fab2bf0ed6c46fd04d41bc6a549e4a3ae9f5a2c45e0a595abc3202ec2