Pith. sign in

Paper Citation Record · LEDGER

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models

As of 21 August 2026, this Paper Citation Record lists 52 of 52 outbound references and 0 inbound Pith citation observations for arXiv:2501.10714.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.10714 v1

Coverage vector

measured 52 of 52 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-10T19:05:55.300522Z

measured 52 of 52 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

52 of 52 outbound references displayed

  • verified exact0
  • verified fuzzy34
  • unresolved18
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 6eca6e43-5a8a-4632-be01-fc69e718477d · outbound

This paper cites https://developer.nvidia.com/blog/doubling-all2all- performance-with-nvidia-collective-communication-library-2-12/.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models https://developer.nvidia.com/blog/doubling-all2all- performance-with-nvidia-collective-communication-library-2-12/

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.906955Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.113340Z digest=sha256:357842c002abd711081ef18bbc7c1a19eab364447fcf4ae21244018645159bc6

Observation 7ae7939d-1a8c-450f-ae8a-9912a56d556d · outbound

This paper cites Deepspeed-inference: enabling efficient infer- ence of transformer models at unprecedented scale.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Deepspeed-inference: enabling efficient infer- ence of transformer models at unprecedented scale

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.895967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.117819Z digest=sha256:45b771f2f22f01a1ec809abee2d57cd129ac869da61d6e234342292f166e90a5

Observation a8bf19b0-5037-4016-a15e-e11f7b484f37 · outbound

This paper cites Language models are few-shot learners.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Language models are few-shot learners

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.121971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.121971Z digest=sha256:792508255decb8852723448a519e90116b31edb75f035f6d0b312c0a0ef691d9

Observation 0dfe1503-fe16-4ecd-9e8c-9c6b07ef8dd9 · outbound

This paper cites FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.126143Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.126143Z digest=sha256:8b73106003260104fe06db8cfce80839654f063dd7debc5d82c624d9e823c568

Observation 07bbda01-9b0a-45de-a31f-80cd7be94982 · outbound

This paper cites Centauri: Enabling efficient sched- uling for communication-computation overlap in large model train- ing via communication partitioning.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Centauri: Enabling efficient sched- uling for communication-computation overlap in large model train- ing via communication partitioning

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.877549Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.130548Z digest=sha256:a4129c361958b0a3510361ce4cfd97dffaacaaae2997294eb9dc6250196ed69d

Observation 2c3471e6-22bb-4817-a501-5d26b5371634 · outbound

This paper cites On the representation collapse of sparse mixture of experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models On the representation collapse of sparse mixture of experts

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.866473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.134272Z digest=sha256:2cb2e090e01a346df4747bed643eddfe0e952709182c47912207fa353edfa005

Observation 91b8be49-ef8e-47b9-87da-b812022e2b72 · outbound

This paper cites Palm: Scaling language modeling with pathways.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Palm: Scaling language modeling with pathways

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.138161Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.138161Z digest=sha256:5a85c87103c9cb8250e5ddf75480a1d5899c7fc1b4b9e036157e840403ed96e1

Observation 96093689-98ff-4c7c-82c8-acc315e8ae4f · outbound

This paper cites Stablemoe: Stable routing strategy for mixture of experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Stablemoe: Stable routing strategy for mixture of experts

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.849207Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.141579Z digest=sha256:0e04fa2a560e781ddae9f073fe1d36b286d8acbb0bc0b1307e25710568bbbaa7

Observation a9ed7357-2285-4a41-83fc-f6ff33610287 · outbound

This paper cites Large scale distributed deep networks.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Large scale distributed deep networks

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.145012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.145012Z digest=sha256:53675b5522086a178f9663db33c6ea06e051388b5db08554a104fdf25ce3eaf7

Observation 27b22620-c9b6-4b58-bc38-3cf0ad4ac1fd · outbound

This paper cites Deepseek-v2: A strong, economical, and efficient mixture-of-experts language model, 2024.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Deepseek-v2: A strong, economical, and efficient mixture-of-experts language model, 2024

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.148417Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.148417Z digest=sha256:4f28cf262e69fed855ec71da4b14aa8b96b569d03c04a69406be57db216c7240

Observation b705c846-265e-4b57-8a8f-d58dbca2b99f · outbound

This paper cites PaLM-E: An Embodied Multimodal Language Model.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models PaLM-E: An Embodied Multimodal Language Model

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.151848Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.151848Z digest=sha256:93ba3b70696a39c6dfb2e9a4c9566dbafffed1be057201ac80786f30cd7a49cd

Observation f150b62a-8c17-4517-afe3-92c62b7d4306 · outbound

This paper cites Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.155744Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.155744Z digest=sha256:cd66955414b1ffd4db89485a0e49f3341dd6f9aef4d0bde59e74991cfd9d4ba7

Observation e984d50e-df31-4780-aa12-a2adcb3a7427 · outbound

This paper cites FastMoE: A Fast Mixture-of-Expert Training System.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models FastMoE: A Fast Mixture-of-Expert Training System

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.159063Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.159063Z digest=sha256:7229fae98930abf5b95172b58b2ebb723ffd81e3d0100fc9666802c5804d86e8

Observation 3f4daa76-9012-4571-9e41-e1ff91bc8ae1 · outbound

This paper cites FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.815293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.163115Z digest=sha256:1d33a93255c866b147a2f828c0b35f52ec1f5742405a1a8db2b30d3e653d1842

Observation 18eda69a-b686-4d42-ba83-a3c27739cd61 · outbound

This paper cites Gpipe: Efficient training of giant neural networks using pipeline parallelism.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Gpipe: Efficient training of giant neural networks using pipeline parallelism

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.166393Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.166393Z digest=sha256:1f4b8600e066153c4fa71d23a50220f790e2332f9f6f771e5ba3896887ba2a79

Observation 78f4a3b7-a753-4059-98a5-2809dbed33f5 · outbound

This paper cites Experts Weights Averaging: A New General Training Scheme for Vision Transformers.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Experts Weights Averaging: A New General Training Scheme for Vision Transformers

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.169824Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.169824Z digest=sha256:cea7a316998bc20d61f931b92a83aa41661f5ab4b79fc9acf4961e032467f3b4

Observation 634bc3ae-50d3-473e-a721-10f5ad0a058d · outbound

This paper cites Tutel: Adaptive mixture-of-experts at scale.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Tutel: Adaptive mixture-of-experts at scale

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.797394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.173791Z digest=sha256:a20bbc7338543f335720e52eb40fcaf2ed15bfb73565597eba0183fe00a5107c

Observation 83246816-fbbf-4c31-8cf4-f1b71791528f · outbound

This paper cites Breaking the computation and communication abstraction barrier in distributed machine learning workloads.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Breaking the computation and communication abstraction barrier in distributed machine learning workloads

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.786294Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.177255Z digest=sha256:2ad0b8407e80f0ba67efbb21db87e3906ec3daf46a83431f5b9a3b78e237c0b7

Observation 7088d145-0197-4f83-ab97-0eee12afdced · outbound

This paper cites Highly scalable deep learning training system with mixed-precision: Training ImageNet in four minutes.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Highly scalable deep learning training system with mixed-precision: Training ImageNet in four minutes

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.775383Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.180968Z digest=sha256:84f208f7e9017f1892430a3218cf22e1969c636be935e1c73642f2abb9283646

Observation e201b5e5-da61-4f10-9622-d1c5cf2c216a · outbound

This paper cites Mixtral of Experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Mixtral of Experts

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.184623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.184623Z digest=sha256:91fe7fa56773ada1c7f2504ff1289298f4ef8b626a7ec9520d0713d3e49ec0cb

Observation fd46062d-05f2-4e73-b91b-3ebd3e54bb9d · outbound

This paper cites Lancet: Accelerating mixture-of-experts training by over- lapping weight gradient computation and all-to-all communication.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Lancet: Accelerating mixture-of-experts training by over- lapping weight gradient computation and all-to-all communication

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.763414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.188654Z digest=sha256:c80cd0e9833c0328d79e0a69f6af2f05bbd66a0baa01672d4621aab525aea4bc

Observation 339ab4a9-001b-4c33-a978-aa7fe1876c84 · outbound

This paper cites Gshard: Scaling giant models with conditional compu- tation and automatic sharding.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Gshard: Scaling giant models with conditional compu- tation and automatic sharding

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.752070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.192429Z digest=sha256:392c43d68615e6b275c2d0df5c81d672374230fbe7d5206ba261b00270a19b3a

Observation b95e5bc8-9bad-4eae-b600-eddb1a94b54b · outbound

This paper cites BASE layers: Simplifying training of large, sparse models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models BASE layers: Simplifying training of large, sparse models

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.741240Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.196205Z digest=sha256:1cdd7eb485af9885cf4b51241fde90cfe840f256cf221dbe92004fe126ec86ad

Observation 8fb7b99b-61d0-48b7-882b-b28145780031 · outbound

This paper cites Acceler- ating distributed{MoE} training and inference with lina.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Acceler- ating distributed{MoE} training and inference with lina

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.730249Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.199901Z digest=sha256:7b191eb1b8423895babd13e69136b40eae7c32484fc482f2e36fc7784b6c4845

Observation 71b22f36-7a78-4d02-b6df-3910757c8aae · outbound

This paper cites Janus: A unified dis- tributed training framework for sparse mixture-of-experts models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Janus: A unified dis- tributed training framework for sparse mixture-of-experts models

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.717844Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.203250Z digest=sha256:b3a341d5a511fab5c2cfb728ca2fc4eed6fb9af76e2255a20d8ecc7d368481c2

Observation 36092380-1151-4b27-8fc5-ccf28957205b · outbound

This paper cites Gating dropout: Communication-efficient regularization for sparsely activated transformers.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Gating dropout: Communication-efficient regularization for sparsely activated transformers

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.704357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.206956Z digest=sha256:075db293d9988113de3c005dfc120d24788c2757b9b02818a6114fa2ba8a9e82

Observation a3148a43-8b3e-42db-a45f-4a910214841e · outbound

This paper cites Modeling task relationships in multi-task learning with multi- gate mixture-of-experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Modeling task relationships in multi-task learning with multi- gate mixture-of-experts

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.691636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.210485Z digest=sha256:96197ac3198615fc81257bc564a1ae30d059c6a206a5e2c441018c206593a7d9

Observation ee9cd83a-4fed-4246-ad23-f565fc339481 · outbound

This paper cites Bagualu: targeting brain scale pretrained models with over 37 million cores.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Bagualu: targeting brain scale pretrained models with over 37 million cores

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.678285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.214438Z digest=sha256:3990b7626811e54b5d3b74f00a1b3d964e9c4b54608efb687759b25df2909d6d

Observation f4051df7-4d54-4b72-a120-664d48e2a369 · outbound

This paper cites Efficient large- scale language model training on GPU clusters using Megatron-LM.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Efficient large- scale language model training on GPU clusters using Megatron-LM

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.664058Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.218354Z digest=sha256:fd1f6290d966ef38b36270c06bcd1cea288b92bbc63490e83881e7b112c3dd60

Observation df6aacf6-b731-4fa8-a8e7-6483b5eca643 · outbound

This paper cites Flexmoe: Scaling large-scale sparse pre-trained model training via dynamic device placement.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Flexmoe: Scaling large-scale sparse pre-trained model training via dynamic device placement

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.645363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.222298Z digest=sha256:8e1b0a6be1cdea0750a864f488373fcc3d7276ad742256287baa54a746a510ff

Observation 7a7c8003-d358-44a5-8c97-ee152cf73e38 · outbound

This paper cites HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.225891Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.225891Z digest=sha256:c83cad569591c28f680f3268c4041876ef68f1ef10f33c9c23311bec848ad65b

Observation 5e0c7257-5456-482f-b6bc-294482416b5e · outbound

This paper cites Springer, 1999.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Springer, 1999

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.229870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.229870Z digest=sha256:40df2e5ec03f322b829d05316361f0062029dcabad7fab5b04b058b1d3106ead

Observation 1b9e643d-5a85-4770-8283-463e0c0ee288 · outbound

This paper cites Parm: Efficient training of large sparsely-activated models with dedicated schedules.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Parm: Efficient training of large sparsely-activated models with dedicated schedules

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.623764Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.233478Z digest=sha256:f6f979b0b6890020afb0dca632dfb3961c4cf3c6f37de9d60b3cdfc461e6b5e1

Observation 637c6623-802f-4d7d-94e8-908e7294bf6b · outbound

This paper cites Sinclair.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Sinclair

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.610245Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.236995Z digest=sha256:10e45ed67a37db81c520eddb3bf5fa3291e4e1cdcde277ac346d1b42d4f30220

Observation dcf067a7-1b92-4851-b2f1-48df2593038a · outbound

This paper cites Differential evolution.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Differential evolution

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.597154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.240768Z digest=sha256:35eaf6e59a3d36c0eb2be9b2ed2780a8297b87c21e37d58784216bd9e3a3714f

Observation 97fbd66a-aa5f-4700-a6e9-6a3ee8637a87 · outbound

This paper cites From Sparse to Soft Mixtures of Experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models From Sparse to Soft Mixtures of Experts

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.244443Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.244443Z digest=sha256:4c8027afca92ad01bb9f80703f2b4172806385147cfbdf0b6790b5bf99386566

Observation 9527e6fe-90cd-4b97-be65-8a0bddcc8609 · outbound

This paper cites Beckmann.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Beckmann

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.583586Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.248468Z digest=sha256:2a08c00511cdf761eeb8c2ca9e1cac5f629fcf5b9358a5208797f26cbada5bd5

Observation 63a85fec-f237-48cf-a2aa-62c79a08a610 · outbound

This paper cites Language models are unsupervised multitask learners.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Language models are unsupervised multitask learners

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.252114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.252114Z digest=sha256:1799089f2c2b9d44380c9f13e4a759ea826566037428ebf880d4212d6dcd2867

Observation 936a2d2d-802f-491f-bae0-7c05ef6573c6 · outbound

This paper cites Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.560292Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.255661Z digest=sha256:7ce96f9b8f4f5bb8e193f81318c0d17310c440331c843f0638ba1bf62c59b251

Observation bb688046-91ee-43d3-96bf-356c9dabf994 · outbound

This paper cites Outrageously large neural networks: The sparsely-gated mixture-of-experts layer.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Outrageously large neural networks: The sparsely-gated mixture-of-experts layer

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.546293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.259055Z digest=sha256:c8d50c08766f141dcaa58be1f322106883514e32cd802de84f3de5ddec7a40d6

Observation 8829b396-86f2-4407-b2a7-edefdf954dd6 · outbound

This paper cites Exploiting simultaneous communications to accelerate data parallel distributed deep learning.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Exploiting simultaneous communications to accelerate data parallel distributed deep learning

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.533093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.263102Z digest=sha256:cc400b5812e45d918ed152d3dff3b24318bc5ca562cba670abbff30825471ed1

Observation 6cb210e4-3597-4aea-b8ef-2c3ed4f88006 · outbound

This paper cites PipeMoE: Ac- celerating mixture-of-experts through adaptive pipelining.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models PipeMoE: Ac- celerating mixture-of-experts through adaptive pipelining

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.518217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.266430Z digest=sha256:35f9c93c4fd7365a76883cf717f01f9b79c46f26b2928a63e7f50c01202fdcc4

Observation 5ade87aa-a439-476f-97d5-c54b1ed5f19d · outbound

This paper cites Schemoe: An ex- tensible mixture-of-experts distributed training system with tasks scheduling.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Schemoe: An ex- tensible mixture-of-experts distributed training system with tasks scheduling

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.504495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.269557Z digest=sha256:5a488fa679adc632854b5831bc6523aaf6cf3029c485783e22cf9e866b9bf5c0

Observation 3fa568d8-b289-4def-bee2-4f77473dc4e9 · outbound

This paper cites A hybrid tensor-expert- data parallelism approach to optimize mixture-of-experts training.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models A hybrid tensor-expert- data parallelism approach to optimize mixture-of-experts training

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.485399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.273159Z digest=sha256:9020d15a187c0db27301a4ec4cf4acce9c639b2e3df95e4f60dfe14b1405ab50

Observation e9e45f2c-f3cd-4126-b2c9-30360a6bdf08 · outbound

This paper cites Attention is all you need.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Attention is all you need

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.276366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.276366Z digest=sha256:c5624aba01e7035fe2d21265f0aeea8b2f6702a947b1da562f53335056241c0f

Observation 2b2112e4-8c85-4dc1-85ab-63011375483b · outbound

This paper cites Overlap communication with dependent compu- tation via decomposition in large deep learning models.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Overlap communication with dependent compu- tation via decomposition in large deep learning models

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.468097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.279486Z digest=sha256:a1f0e2964dacf6db4f4aaee8fb362579e427f901e624f37a55ff66599d30cfba

Observation d8952115-49a6-4eb3-8d5f-a75eb3d24060 · outbound

This paper cites Large batch optimization for deep learning: Training BERT in 76 minutes.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Large batch optimization for deep learning: Training BERT in 76 minutes

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.457249Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.282689Z digest=sha256:20da4c7ac45fbbe1c451ecff05fd4733262d53b27599713cbafe52e46b7be1d8

Observation 3c0f0013-3795-4faa-acdd-7e56b87e99e7 · outbound

This paper cites SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.285944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.285944Z digest=sha256:faacd482c546a1b1b293d56985449e75c6beacf6b5d867b2f59435748cc7e26b

Observation 9c5b9b8b-b453-497a-906e-b1a03ab170a3 · outbound

This paper cites SmartMoE: Efficiently training Sparsely-Activated mod- els through combining offline and online parallelization.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models SmartMoE: Efficiently training Sparsely-Activated mod- els through combining offline and online parallelization

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.446707Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.289368Z digest=sha256:1ae82acff912eb8ef82cfa600bd0ac34d6051b251b8ffbc28e4727e06d4987d4

Observation d9c12ac6-24df-4160-81c0-2d54e0dd9b73 · outbound

This paper cites Pit: Optimization of dynamic sparse deep learning models via permutation invariant transformation.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Pit: Optimization of dynamic sparse deep learning models via permutation invariant transformation

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.435346Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.292629Z digest=sha256:6241b410254c194e03b6287b4be929d2052cc5c6d0f787d0049bbe806245074c

Observation 487fa7b9-974a-45bc-9f95-830f85be3280 · outbound

This paper cites Mixture-of-Experts with Expert Choice Routing.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Mixture-of-Experts with Expert Choice Routing

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-10T19:05:55.296446Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-10T19:05:55.296446Z digest=sha256:be7dac41f3d7d2c2735d19e59266f7d5ab1e44ba18daf44a3caae12f21fb7448

Observation f4b27ede-16fc-4098-bbbe-a828271fcf63 · outbound

This paper cites Taming sparsely activated transformer with stochastic experts.

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models Taming sparsely activated transformer with stochastic experts

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-10T19:05:55.423266Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-10T19:05:55.300522Z digest=sha256:75ee8912042faa545b71025b0c576e3b81ebec6488df2e253bd6627dc0bdc3b8

Pith citing papers

No inbound Pith citation observations are available.