Paper Citation Record · LEDGER

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism

As of 15 August 2026, this Paper Citation Record lists 38 of 38 outbound references and 0 inbound Pith citation observations for arXiv:2608.08650.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.08650 v1

Coverage vector

measured 38 of 38 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-14T04:32:58.446447Z

measured 38 of 38 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

38 of 38 outbound references displayed

verified exact2
verified fuzzy7
unresolved29
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 155412e3-7d0f-44fa-acc7-9d39d244d27b · outbound

This paper cites an unresolved cited work.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Unresolved cited work

Reference 37

Resolution: unresolved; raw_fallback, observed 2026-08-14T04:32:59.257784Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation f7f081eb-159f-4567-ba8b-42f519014d53 · outbound

This paper cites an unresolved cited work.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Unresolved cited work

Reference 38

Resolution: unresolved; raw_fallback, observed 2026-08-14T04:32:59.232328Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 88128731-e303-4cc8-b293-7508c5abf31e · outbound

This paper cites 总 All-to-All 时间.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism 总 All-to-All 时间

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:32:59.213592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 1b015d02-473e-477d-8c0c-00fff5e8c6e9 · outbound

This paper cites A Survey on Mixture of Experts in Large Language Models.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism A Survey on Mixture of Experts in Large Language Models

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:32:59.384791Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 78903f03-9259-4bf6-9fd4-697cb33ce04b · outbound

This paper cites A Survey on Mixture of Experts in Large Language Models.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism A Survey on Mixture of Experts in Large Language Models

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.257289Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8f2b9ad3-4bc8-440b-b148-5692f207abeb · outbound

This paper cites A Survey on Inference Optimization Techniques for Mixture of Experts Models.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism A Survey on Inference Optimization Techniques for Mixture of Experts Models

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.262836Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61c66eaf-ae8f-4359-9f8e-fc8da2449351 · outbound

This paper cites Speed Always Wins: A Survey on Efficient Architectures for Large Language Models.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Speed Always Wins: A Survey on Efficient Architectures for Large Language Models

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.267934Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8984cb4b-f455-4def-9e56-094faf9ff28f · outbound

This paper cites Adaptive Mixtures of Local Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Adaptive Mixtures of Local Experts

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.273267Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2a1ecfed-c799-4c62-858a-1ffa1c4724dc · outbound

This paper cites Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.279219Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd8cec16-c0d2-493a-953e-44a51c39c2ad · outbound

This paper cites GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.284500Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c43a1dfd-0197-4799-aa11-1113006dd440 · outbound

This paper cites Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.289591Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c45be21f-5096-447c-9f5f-f1fe7941a958 · outbound

This paper cites ST-MoE: Designing Stable and Transferable Sparse Expert Models.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism ST-MoE: Designing Stable and Transferable Sparse Expert Models

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.294305Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a98cf91f-94b7-4bdc-afd9-d0719badc588 · outbound

This paper cites BASE Layers: Simplifying Training of Large, Sparse Models.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism BASE Layers: Simplifying Training of Large, Sparse Models

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.299078Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 32714d3f-e41a-46c4-90d8-7886c02c8b33 · outbound

This paper cites Mixture-of-Experts with Expert Choice Routing.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Mixture-of-Experts with Expert Choice Routing

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.304689Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 61850748-812c-48c4-941f-dec0ffaa1b60 · outbound

This paper cites Mixtral of Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Mixtral of Experts

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.311824Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 31688b3b-bc2c-40b5-9c15-8cc59de059d1 · outbound

This paper cites DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.316527Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 07ebc0aa-91b1-4fa2-a626-cbea7ee04639 · outbound

This paper cites DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.321856Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1b20fc12-e4e1-4461-94ac-0d948153fc82 · outbound

This paper cites Arctic: Snowflake’s Open-Source LLM.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Arctic: Snowflake’s Open-Source LLM

Reference 54

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:32:59.365891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 192b8514-451f-4f73-8613-4e8da2c1d24a · outbound

This paper cites Qwen3 Technical Report.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Qwen3 Technical Report

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.334915Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 879cd6f2-c6d0-4b73-a76a-4efda08f2733 · outbound

This paper cites Mixture of A Million Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Mixture of A Million Experts

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.340157Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1f73fa79-2c97-4189-945a-659621f98fed · outbound

This paper cites Kimi K2: Open Agentic Intelligence.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Kimi K2: Open Agentic Intelligence

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.345266Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ab426b07-485c-4686-a67a-560098855d76 · outbound

This paper cites gpt-oss Model Card: Architecture.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism gpt-oss Model Card: Architecture

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:32:59.345701Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d634a2cc-ec24-42c7-8c8e-5debaca623cb · outbound

This paper cites LongCat-Flash Technical Report.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism LongCat-Flash Technical Report

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.356618Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6b6f590d-e17a-4d7c-ab6a-4bd47c855fca · outbound

This paper cites Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Experts

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.362126Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8f27f14c-fbd6-44e2-998d-1f1b0f54fc92 · outbound

This paper cites LongCat 2.0 Technical Blog.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism LongCat 2.0 Technical Blog

Reference 61

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:32:59.317922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 898a66da-b382-4426-9b70-927251efbefc · outbound

This paper cites MoHGE: Mixture of Heterogeneous Grouped Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism MoHGE: Mixture of Heterogeneous Grouped Experts

Reference 62

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:32:59.297216Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6226d18c-7617-47dd-86bf-e488410062da · outbound

This paper cites GMoE: Global Mixture-of-Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism GMoE: Global Mixture-of-Experts

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-08-14T04:32:59.277555Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 42e1fceb-5840-425e-a95c-c0374e5b5b72 · outbound

This paper cites Multi-Head LatentMoE and Head Parallel.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Multi-Head LatentMoE and Head Parallel

Reference 64

Resolution: verified exact; raw_fallback, observed 2026-08-14T04:32:58.792734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6ea333fd-a000-4440-a917-4a2dd234c26b · outbound

This paper cites Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints

Reference 65

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.393621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a7fe1c8-47ff-462b-8b70-68986a7d781b · outbound

This paper cites Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts

Reference 67

Resolution: verified exact; local_arxiv, observed 2026-08-14T04:32:58.684185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6bd2c283-d122-4b69-83c7-0fa779d27a17 · outbound

This paper cites From Sparse to Soft Mixtures of Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism From Sparse to Soft Mixtures of Experts

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.409771Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fa229c4d-40aa-428a-80f9-51b3769444ac · outbound

This paper cites Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.414782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d413417b-2018-4afc-b784-c10df13c43d0 · outbound

This paper cites Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts

Reference 70

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.419634Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 21f6a2cc-cb6e-41bf-a386-d66cf431e1e2 · outbound

This paper cites DeepSeek-V3 Technical Report.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism DeepSeek-V3 Technical Report

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.425384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5e4dd52a-1fc9-48fe-891b-a29c91793666 · outbound

This paper cites MegaBlocks: Efficient Sparse Training with Mixture-of-Experts.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism MegaBlocks: Efficient Sparse Training with Mixture-of-Experts

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.430621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 47e0c6d9-4338-48fe-8537-2c9497c55301 · outbound

This paper cites Tutel: Adaptive Mixture-of-Experts at Scale.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Tutel: Adaptive Mixture-of-Experts at Scale

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.435499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 96585586-e007-4b53-a86a-6917574ca7c4 · outbound

This paper cites JetMoE: Reaching Llama2 Performance with 0.1M Dollars.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism JetMoE: Reaching Llama2 Performance with 0.1M Dollars

Reference 74

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.441113Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a825bfe9-00c2-4a9d-aa07-a6cb2e9774a0 · outbound

This paper cites Jamba: A Hybrid Transformer-Mamba Language Model.

The Evolution of Mixture-of-Experts Architectures in Large Language Models: Routing, Topology, Load Balancing, and Expert Parallelism Jamba: A Hybrid Transformer-Mamba Language Model

Reference 75

Resolution: unresolved; no resolver link, observed 2026-08-14T04:32:58.446447Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.