Paper Citation Record · LEDGER

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking

As of 11 August 2026, this Paper Citation Record lists 33 of 33 outbound references and 0 inbound Pith citation observations for arXiv:2602.21196.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2602.21196 v2

Coverage vector

measured 33 of 33 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T21:11:51.292724Z

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

33 of 33 outbound references displayed

verified exact0
verified fuzzy0
unresolved33
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation c99560fe-254d-461e-b429-c9517ab8539e · outbound

This paper cites write newline.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking write newline

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:47.906779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6b7a624e-99ee-42be-84d2-49e96250f034 · outbound

This paper cites GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.019583Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f68b75ca-1d76-4926-b339-af583cf09ac8 · outbound

This paper cites Arctic Long Sequence Training: Scalable And Efficient Training For Multi-Million Token Sequences.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Arctic Long Sequence Training: Scalable And Efficient Training For Multi-Million Token Sequences

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.095184Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation afd8f254-9ddd-4193-9ac6-e7ee3efeba62 · outbound

This paper cites MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.153620Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 96885c7e-b90e-4767-8fde-157aae7cddaa · outbound

This paper cites M-Longdoc: A Benchmark For Multimodal Super-Long Document Understanding And A Retrieval-Aware Tuning Framework.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking M-Longdoc: A Benchmark For Multimodal Super-Long Document Understanding And A Retrieval-Aware Tuning Framework

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.243215Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1e2d119-88ba-4606-bd02-3953d6af281a · outbound

This paper cites Y., Ermon, S., Rudra, A., and R \'e , C.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Y., Ermon, S., Rudra, A., and R \'e , C

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.328966Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8cda7e97-6288-4297-9187-bcb71248e09d · outbound

This paper cites USP: A Unified Sequence Parallelism Approach for Long Context Generative AI.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking USP: A Unified Sequence Parallelism Approach for Long Context Generative AI

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.416657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1f768da-03cd-436e-8b4a-4fb7ae1a4679 · outbound

This paper cites Gemini 3.0: A new era of intelligence with gemini 3.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Gemini 3.0: A new era of intelligence with gemini 3

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.587505Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 55cd6d9f-3cba-42f5-8de9-4db081f938f5 · outbound

This paper cites The Llama 3 Herd of Models.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking The Llama 3 Herd of Models

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.708496Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b8a64e6-f660-40a4-99ac-8949748bea35 · outbound

This paper cites Unsloth, 2023.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Unsloth, 2023

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.861211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2dcfedae-0636-4195-a19d-59acb3f1eb3f · outbound

This paper cites Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Advanced Long-context End-to-end Speech Recognition Using Context-expanded Transformers

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:48.953565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4190dcf3-bdb3-4e09-a596-5bd0f0cdfc3c · outbound

This paper cites Liger-kernel: Efficient triton kernels for LLM training.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Liger-kernel: Efficient triton kernels for LLM training

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.060784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 001bd1f1-5071-4097-8ae6-d3ae4e2eaf8c · outbound

This paper cites Qwen2.5-Coder Technical Report.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Qwen2.5-Coder Technical Report

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.195785Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ea053d39-524b-43bb-b29e-3471a748a529 · outbound

This paper cites DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.350958Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c96becb5-636f-4967-96d9-4265da21b165 · outbound

This paper cites Mistral 7B.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Mistral 7B

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.493389Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25749982-9c90-41c1-a6d2-5bdb6013d582 · outbound

This paper cites LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.632698Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8edc2120-d570-4a4a-8b49-e52572cbe760 · outbound

This paper cites Kimi K2: Open Agentic Intelligence.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Kimi K2: Open Agentic Intelligence

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.698578Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25597e34-7a25-4688-a37f-d0c9ac86d4fa · outbound

This paper cites Reducing Activation Recomputation in Large Transformer Models.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Reducing Activation Recomputation in Large Transformer Models

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.812534Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5563856c-5726-4244-98e2-77337331e676 · outbound

This paper cites StarCoder: may the source be with you!.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking StarCoder: may the source be with you!

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:49.946228Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0a064b01-f126-40e6-bf92-a8c2d30f1b24 · outbound

This paper cites Sequence Parallelism: Long Sequence Training from System Perspective.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Sequence Parallelism: Long Sequence Training from System Perspective

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.032377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67abdf03-4eaa-42b9-a064-545937294de6 · outbound

This paper cites Sequence parallelism: Long sequence training from system perspective.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Sequence parallelism: Long sequence training from system perspective

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.141072Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eee07d3f-0a17-4640-afd9-3d4765fae34e · outbound

This paper cites Torchtitan: One-stop pytorch native solution for production ready LLM pretraining.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Torchtitan: One-stop pytorch native solution for production ready LLM pretraining

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.244468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2082e951-a090-4af2-8b19-a5badeed4f86 · outbound

This paper cites Ring Attention with Blockwise Transformers for Near-Infinite Context.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Ring Attention with Blockwise Transformers for Near-Infinite Context

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.310017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f50b51a8-d40d-4473-ad95-6f265343e380 · outbound

This paper cites MAGI-1: Autoregressive Video Generation at Scale.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking MAGI-1: Autoregressive Video Generation at Scale

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.391061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a9875024-4b17-4f39-b112-889bd3585726 · outbound

This paper cites FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.475375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fb5aa8ca-ed68-452b-8ff0-a1db0ab6c9c8 · outbound

This paper cites RoFormer: Enhanced Transformer with Rotary Position Embedding.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking RoFormer: Enhanced Transformer with Rotary Position Embedding

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.563806Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c3ff2873-f83a-469e-ade1-6898833286c3 · outbound

This paper cites Wan: Open and Advanced Large-Scale Video Generative Models.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Wan: Open and Advanced Large-Scale Video Generative Models

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.645700Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6f46242a-be0f-4f88-a349-e6cf3f157d53 · outbound

This paper cites N., Kaiser, L., and Polosukhin, I.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking N., Kaiser, L., and Polosukhin, I

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.774863Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 83960181-6e2b-4ede-8d1f-f2233a667b44 · outbound

This paper cites HunyuanVideo 1.5 Technical Report.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking HunyuanVideo 1.5 Technical Report

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:50.925574Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7cb410f2-0c61-40f6-b4b6-97a6acbd66e3 · outbound

This paper cites Qwen3 Technical Report.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Qwen3 Technical Report

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:51.044030Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b78d2d07-028f-4631-9aff-1f837a23dda8 · outbound

This paper cites SimpleSpeech: Towards Simple and Efficient Text-to-Speech with Scalar Latent Transformer Diffusion Models.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking SimpleSpeech: Towards Simple and Efficient Text-to-Speech with Scalar Latent Transformer Diffusion Models

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:51.164939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f7629dfe-3273-4b4e-95e1-5320c0571101 · outbound

This paper cites Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:51.253437Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f4cfafaf-795e-49b0-bafe-c0b38fc668cf · outbound

This paper cites PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Untied Ulysses: Memory-Efficient Context Parallelism via Headwise Chunking PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-02T21:11:51.292724Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.