Pith. sign in

Paper Citation Record · LEDGER

Theory, Analysis, and Best Practices for Sigmoid Self-Attention

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 18 inbound Pith citation observations for arXiv:2409.04431.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2409.04431 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 18 of 18 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 18 of 18 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T11:46:59.381114Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T21:17:24.595834Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 4c4a8870-83d9-4669-b8e3-f76ba36b05fd · inbound

When Attention Sink Emerges in Language Models: An Empirical View cites this paper.

When Attention Sink Emerges in Language Models: An Empirical View Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 42

Resolution
metadata mismatch
arxiv_id, observed 2026-05-16T17:41:03.735502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-05-16T17:41:03.674759Z digest=sha256:3d13e95a54b42e9973bae1c23ed20083319a5d84cfe98caf562c4ea40d2e4a71

Observation c125d649-43ce-4369-910f-d547675c7ca4 · inbound

Unpacking Softmax: How Temperature Drives Representation Collapse, Compression, and Generalization cites this paper.

Unpacking Softmax: How Temperature Drives Representation Collapse, Compression, and Generalization Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T11:46:59.381114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:46:59.381114Z digest=sha256:8c969160d2e7c1f104771f12e4fd0c67b3f960e3c812e067237f0ec584941500

Observation 2737a320-d6ae-4494-b67f-3d9d3bf4cc1d · inbound

A Theoretical Study of (Hyper) Self-Attention through the Lens of Interactions: Representation, Training, Generalization cites this paper.

A Theoretical Study of (Hyper) Self-Attention through the Lens of Interactions: Representation, Training, Generalization Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-07T06:10:19.778678Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T06:10:19.778678Z digest=sha256:a9914fd38a4a43179ded0716840a42129ca7cd2c16112ee213c0bf53a7bca420

Observation ffc2af75-1f8e-4578-b29a-6f39eeb387ac · inbound

Scaling Context Requires Rethinking Attention cites this paper.

Scaling Context Requires Rethinking Attention Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-06T20:00:43.782864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T20:00:43.782864Z digest=sha256:69355717269e61630f8eb6f7dc2e0a8d2cb05e2ad7b069fa8b23f24c737bd305

Observation 3b93fb8e-4c74-4dcb-aca6-d41795f98465 · inbound

Your Attention Matters: to Improve Model Robustness to Noise and Spurious Correlations cites this paper.

Your Attention Matters: to Improve Model Robustness to Noise and Spurious Correlations Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T13:39:10.426250Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:39:10.426250Z digest=sha256:b72ca73e422f52d079325e3c55a5af40843a24904ddaf6e177df5ea574407402

Observation e38e9aa0-9fda-4b27-abae-cde295d70edc · inbound

Capacity-Controlled Global Attention for Graph Transformers cites this paper.

Capacity-Controlled Global Attention for Graph Transformers Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 25

Resolution
metadata mismatch
arxiv_id, observed 2026-05-10T06:31:30.767360Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T06:27:24.557866Z digest=sha256:f6258b8ecbb2410ee329e51dab92c166ef1073cf05933b84070f5cef55e513c7

Observation f86867b3-92f9-4a80-a47b-29f35ab9a31c · inbound

Cubit: Token Mixer with Kernel Ridge Regression cites this paper.

Cubit: Token Mixer with Kernel Ridge Regression Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 63

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T19:06:10.787346Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-08T12:38:19.925573Z digest=sha256:58f3ff3b8b9d9f102eb62bb98b03b6adc9597f3616195d6f8e4fdc845b0721e6

Observation b7950fc4-5026-4447-862f-bced4a513992 · inbound

Cubit: Token Mixer with Kernel Ridge Regression cites this paper.

Cubit: Token Mixer with Kernel Ridge Regression Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 63

Resolution
metadata mismatch
arxiv_id, observed 2026-05-20T22:39:11.009258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-20T22:34:36.108826Z digest=sha256:7fbdd4ba54dd65a95652e4b0567002cf4413ad0f2cae977c9fa22ddca7f371f4

Observation a8f9fc8d-b472-4959-8fea-6820f08824cb · inbound

The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity cites this paper.

The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 19

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T19:21:08.516991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-08T12:11:04.146711Z digest=sha256:3c1c7b61d710ec4f72ec5a6b5137d470288d24034a25f219cf6da64e3a74b96f

Observation b1fd8067-78c2-4245-94e1-f0862b4855c7 · inbound

A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models cites this paper.

A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 15

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T07:36:40.797845Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-12T02:29:20.796512Z digest=sha256:788cf90820c8894509a531a28da3947e80682358468996246acf845bb8df83d6

Observation 2ae133e3-518a-4b55-8959-1c2719b83d1e · inbound

A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models cites this paper.

A Single Layer to Explain Them All:Understanding Massive Activations in Large Language Models Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 15

Resolution
metadata mismatch
arxiv_id, observed 2026-05-14T21:19:29.111658Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-14T21:03:25.624300Z digest=sha256:ede6d8362d13b227cb1c5b84d596b9e3145990bcadbe64e611337935240f57a6

Observation d20d30e7-4356-401e-b839-9e29cde7c142 · inbound

Complex-Valued Phase-Coherent Transformer cites this paper.

Complex-Valued Phase-Coherent Transformer Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 7

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T07:16:28.147412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-12T03:34:20.893124Z digest=sha256:0e5c80d277c6d3bb4777c6ea50f34b922512a8749a2bb704b02f8da053874502

Observation d057774a-4e16-460f-8f77-6f7cac95eb0f · inbound

Complex-Valued Phase-Coherent Transformer cites this paper.

Complex-Valued Phase-Coherent Transformer Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-02T14:31:47.302932Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:31:47.302932Z digest=sha256:3523e09c70f8245f1fc9d296477bef7b2b806cefaa5fc339f4cd4ff51466083f

Observation 16d1e8f8-de0a-4812-82f2-b7527e32b3e9 · inbound

Most Transformer Modifications Still Do Not Transfer at 1-3B: A 2020-2026 Update to Narang et al. (2021) with Downstream Evaluation and a Noise Floor cites this paper.

Most Transformer Modifications Still Do Not Transfer at 1-3B: A 2020-2026 Update to Narang et al. (2021) with Downstream Evaluation and a Noise Floor Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 53

Resolution
verified exact
arxiv_id, observed 2026-05-21T06:19:42.072047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-05-21T06:15:47.451870Z digest=sha256:3ce94a3acf1981ec541f7ff3dcbd16fba62770ab113876c7e7ea9116bc5d8a5b

Observation 830e1fcf-1c26-46f4-8683-29111e1fc631 · inbound

Towards Understanding Self-Pretraining for Sequence Classification cites this paper.

Towards Understanding Self-Pretraining for Sequence Classification Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 178

Resolution
verified exact
arxiv_id, observed 2026-05-21T05:33:58.908338Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-05-21T05:29:58.809024Z digest=sha256:54c911a3280359daab353e324ffedc2f3023992256af4d49a006b6362fc7e826

Observation 9c37073b-4edb-41c7-8e1f-4e2442124a49 · inbound

Forget Attention: Importance-Aware Attention Is All You Need cites this paper.

Forget Attention: Importance-Aware Attention Is All You Need Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 14

Resolution
verified exact
arxiv_id, observed 2026-07-01T23:06:21.024853Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-28T14:38:40.948032Z digest=sha256:e369487973ed50c1268cb1eac346d3286b856030dd23381ff866a3b58102f959

Observation a2f19bb8-9c0a-4305-87cd-56ab4aabf127 · inbound

A Unifying View of Attention Sinks: Two Algorithms, Two Solutions cites this paper.

A Unifying View of Attention Sinks: Two Algorithms, Two Solutions Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 45

Resolution
verified exact
arxiv_id, observed 2026-07-02T21:17:24.597286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-06-27T19:51:41.329591Z digest=sha256:0dc9d630d45335b5503b7ed23a78e31c840c3eaef83e5c70421448c473a8f5b7

Observation b4ea3e01-b25e-48db-861b-8dc620cab92f · inbound

Legible-by-Construction: Attention and End-to-End Transformers cites this paper.

Legible-by-Construction: Attention and End-to-End Transformers Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 8

Resolution
unresolved
no resolver link, observed 2026-07-11T20:06:55.102341Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T20:06:55.102341Z digest=sha256:2383716948d1a386a0ab00d9d4bf976a1e0a9187bf7d4065ee2c3844368e2c31