Pith. sign in

Paper Citation Record · LEDGER

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

As of 10 August 2026, this Paper Citation Record lists 51 of 51 outbound references and 5 inbound Pith citation observations for arXiv:2502.00281.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.00281 v2

Coverage vector

measured 51 of 51 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T19:40:10.117050Z

measured 56 of 56 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T20:49:18.282782Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T09:57:56.071813Z

Reference resolution

51 of 51 outbound references displayed

  • verified exact1
  • verified fuzzy19
  • unresolved31
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e8120a2f-1ed4-4b27-a28e-bd9d932542bb · outbound

This paper cites Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.900330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.900330Z digest=sha256:fa1e5353dece8b22bf6b1e171f9b0c3da648e18fc5aca012f653df291498c03b

Observation c8d8891a-f976-44ad-8f0d-71c3911bb9f6 · outbound

This paper cites Brown, B.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Brown, B

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.203351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.905517Z digest=sha256:76cb7c45d34305aafcf04e8928ffe6c6bfa179797df9e488f82c8a2663a205b3

Observation ab4d4468-b600-4c27-98a4-acc42eef12ad · outbound

This paper cites Carion, F.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Carion, F

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.190297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.910208Z digest=sha256:acf206289e47eeab791cf35c1837b73950f902a8c606dc4e63d7745dd8f4ac69

Observation 10bba22e-00dd-44fc-8f03-aeabe3451f3d · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.177037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.914886Z digest=sha256:2e764bebc96541cf414b08c3378c2f059e13bb0cb791eb6135731109f700b4fd

Observation f0ffd833-082e-4733-997e-b698dcc0f59b · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.163315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.919331Z digest=sha256:6b8f54690229dd5b294dd810815fc55d7ca26af0e30fb4ce6884078a937cc78c

Observation ae242085-d1c6-42e9-a732-924c497e3b57 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.150009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.923873Z digest=sha256:2a3607be7304eeedc38e1b282ac0dae2cb2d8373f7e0dec5268e2396fcffe2c5

Observation 54a17dd1-0fea-454a-b6e9-5fe9fb1fe11a · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.136890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.928662Z digest=sha256:182fca3419c82f283adb8f7a9976eb2bb6b69d5ac0346301365df6e2269a85a4

Observation cf36eb1e-0b80-44d1-88ad-859c22423932 · outbound

This paper cites Csordás, K.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Csordás, K

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.123287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.932953Z digest=sha256:afb30724997b6274e102fd94298cec6ddb613be1353c5428c4a46b1d01a3657a

Observation e45bede9-6c9d-4f26-ad44-2b34d4e07e10 · outbound

This paper cites SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.937100Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.937100Z digest=sha256:06f3d6b58359db0cc8b64aa5ec8678e6ec23b5a2cf934df3814acbc445f93fc8

Observation 43abca66-ad71-4c7e-97b7-77b8e897c22c · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.109063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.941678Z digest=sha256:b79f5089ec00e60c482b5b27b1ef82331fd9e03323fea8d040baf7f592c0f03f

Observation d1b3f20a-c2fd-435f-ba94-91f6aefc0470 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.094932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.945761Z digest=sha256:478517f5e5aae4331ad64109565ba5dd67c5db0c16c71d8f4a73b3262b94255a

Observation fa7dafaf-4d6b-46be-baf8-2b81dce23543 · outbound

This paper cites DeepSeek-V3 Technical Report.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective DeepSeek-V3 Technical Report

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.950221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.950221Z digest=sha256:384dde786ab94abe4bbf6313b624d633553c3969139f2389f995da18f721c989

Observation 253386c7-9ee4-41f6-bb58-3b149a922e74 · outbound

This paper cites Devlin, M.-W.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Devlin, M.-W

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.080979Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.954822Z digest=sha256:2bac4814c20bcdd6b2fa8847f8ed9b7560d00e48d5dc2403985aa8bafe5f676c

Observation d087c60a-ee86-406f-a0b7-7b7b0a1725e2 · outbound

This paper cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.958925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.958925Z digest=sha256:01b381e8c9019d70960ec67f7a15f562e3cbf984c4c60ac8954b7673303462d5

Observation 676de2a8-a1a3-4c58-a6d7-c0899e021e64 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.067577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.963234Z digest=sha256:48296ae9748727cd598438ded791ad7d2322f8a11f539e3b5fe91ee0a57451d1

Observation 599fd6a8-175d-4b02-8c68-7a0bdd711742 · outbound

This paper cites Faria and G.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Faria and G

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.054095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.967335Z digest=sha256:abf0869a411c29069dc09fae1a7563f1612d4a5406cfe46a174c129b97455168

Observation 6e5711a7-2217-4e2b-a1a0-c18ff6caa360 · outbound

This paper cites Fedus, B.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Fedus, B

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.040919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.971313Z digest=sha256:14e8f15ba0147071c3fe0c1852aafa5aa4b3c3f9b7359c295c0e7a2607d0c2fe

Observation db5d1512-5d0d-431c-94ef-e6f6823b6a38 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.027620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.975323Z digest=sha256:05bfd28a32df7dcdc6f876da81ec399cb00fdbc1dfdb41c3fca0d8e6c2606ea3

Observation 94040920-2a3c-4ba5-8fdc-c71943b91d03 · outbound

This paper cites When Attention Sink Emerges in Language Models: An Empirical View.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective When Attention Sink Emerges in Language Models: An Empirical View

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.979304Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.979304Z digest=sha256:70883df6575e1bf1f36e4a855e1d4cee718e4616ad2ce4fae547d48e95b12029

Observation 5f986ff3-09af-4868-9ebb-81821c2c1630 · outbound

This paper cites Hazimeh, Z.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Hazimeh, Z

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.014277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.984123Z digest=sha256:de203e29f5aabc08662c4ca6ad94e0b6be23520a623439a98b2504364ee602f1

Observation bd3c8fad-4ea1-4be6-a400-ced16f5f9f9d · outbound

This paper cites Ho, C.-Y.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Ho, C.-Y

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.001140Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.988056Z digest=sha256:7ca7ca813997ba900c914d14278f0092a85c7bc9eee2cc8224a4ea06c0bede79

Observation 6161a011-10e8-4898-a37e-5bc640160320 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.992027Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.992027Z digest=sha256:baf2483d29c37556a9e3bf4baed78d2ca0c4da852d372a5e1f752f97f5c6f903

Observation 538213f1-c24a-4f17-bbc8-671ad2be8eef · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.987525Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:09.996131Z digest=sha256:0db918d69f52df984005930b5eb710ec591d70f310cfd0ea289e88e8d56de9ad

Observation 74f79a52-ec75-4a5c-826f-5f4a8271b756 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.974348Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.000145Z digest=sha256:99a32baba8e179d5d24adf110361309785d2edf4e84ccdb10056954531a450f1

Observation 98d8873a-e043-433d-85a5-673f82117a78 · outbound

This paper cites Mixtral of Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Mixtral of Experts

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.004105Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.004105Z digest=sha256:c0e3271e8878ec8e7c655f1342781aa2bcea32cb8b1781a161263f0762b66db0

Observation bc98eb83-21b7-4899-8753-b55aa7e3fe1c · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.008682Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.008682Z digest=sha256:2ff1a0459f36313337251b9a6e14748c9fe956fc43e41a602ca410123190a506

Observation 968242c1-feda-412c-b867-0bc959ae2c0b · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.961009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.012895Z digest=sha256:c0da2383e56a7f1f1c27a3476be9e2fe070032ab971ebdcbb312a24bd5c80de6

Observation 2809a598-64be-4929-b590-d4fc542cf60b · outbound

This paper cites Preference Transformer: Modeling Human Preferences using Transformers for RL.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Preference Transformer: Modeling Human Preferences using Transformers for RL

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.017433Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.017433Z digest=sha256:495e9f188a9c2555d445c1770f5a05bbcd373136f2d2bc1ac07dd538c8dbb53e

Observation 26154118-9089-4458-97a9-ec9b9e392146 · outbound

This paper cites Kwon and S.-W.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Kwon and S.-W

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.947431Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.022054Z digest=sha256:8ec3c458d24c53298c5c4e092356bca9159baab9e538a9424fc413d1e72511f1

Observation 8c1220ec-2af6-4db9-af5f-a9a9b87b42bc · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.934201Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.026196Z digest=sha256:f97ca1e6e0ec68e69f9e4d8146800030fe54e9d9010a27fdffa37ce6207d9b49

Observation b6ab5a69-e223-4325-bc4d-737676593977 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.920938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.030423Z digest=sha256:9cac12657a5e798f93c6a9b64ecee128c07164f4698f10b08f2a27c6b33940f9

Observation eaad19f3-c0ac-42c3-9944-674c11baa8d1 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.907333Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.034812Z digest=sha256:e6563cbf35d897d024c5946906f2ffb0d696e09f7692864eab946133b2c3377f

Observation 80e2ac64-eebf-441c-8ea6-aa3007049d4c · outbound

This paper cites Manole and N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Manole and N

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.893918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.039164Z digest=sha256:da7bf812beb3041df3a326fdddf0184fea9f0157d772911520e30cb8e95e11e5

Observation 6a9355de-8d42-45e6-938a-9fc09e2c4049 · outbound

This paper cites Convergence Rates for Mixture-of-Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Convergence Rates for Mixture-of-Experts

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.043497Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.043497Z digest=sha256:de20cabc9af1962640a1af4b93f802acaa0361023631ad9e6f123a17579ca36f

Observation 71feb4ba-a7e5-46a1-9945-9ceb7a7c5eab · outbound

This paper cites OLMoE: Open Mixture-of-Experts Language Models.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective OLMoE: Open Mixture-of-Experts Language Models

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.047855Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.047855Z digest=sha256:91212d08e38530cf0cbd5d305343b9ff511c637aa8382bc7a6e1a2b5de03970d

Observation ab56543d-cac9-4b9e-be45-9a0e599f7307 · outbound

This paper cites Nguyen, P.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, P

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.879965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.052583Z digest=sha256:9d4f3dda87c35b28cbf455db68ef45466fa874df450ef78537114b0965903c4c

Observation baf56675-9f9b-45f7-8540-65b729d3bb66 · outbound

This paper cites On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.056730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.056730Z digest=sha256:4c5e022a5facfd66e87266053267af0aa14913189f6be7d60935384606a732fb

Observation 6178e07b-b68c-43de-8d2f-3c8027c7b27f · outbound

This paper cites Nguyen, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, N

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.865963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.061063Z digest=sha256:b4a9941db2f9ed3fe3b38baa5ee07f567a2485153048748ab1aaa19fdbda65d2

Observation e3a0f99e-2ecb-428b-9498-90a9b789db58 · outbound

This paper cites Nguyen, T.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, T

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.851697Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.065429Z digest=sha256:db70a91519b2b1a3c7a92e437d3c4869ac3a5ebbbf0781f440fe947e462b4a15

Observation 30a20f9a-c936-4ee9-a8e3-552c09ce2cfa · outbound

This paper cites Puigcerver, C.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Puigcerver, C

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.837621Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.069969Z digest=sha256:81160971bbfaba36cf79b630b1dce47c74a0f576537cfa16e3a8e4a0eace0881

Observation c65e66c5-abe5-4307-b1ff-9a324a67e769 · outbound

This paper cites Radford, J.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Radford, J

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.823953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.074169Z digest=sha256:2d9a5894978b27276700f72950d49c477b628442a1e18a776d38e1726bd317ce

Observation 07cf5d11-6c29-4bff-b1d7-cee2ebcd2739 · outbound

This paper cites Raffel, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Raffel, N

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.809871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.078721Z digest=sha256:769f2b13221e4b1fc0247a2adb4c500a25d429cbb3849941472a3b76a5e9d551

Observation 83fe0c0b-b786-43e1-a462-f18671deb5dd · outbound

This paper cites Theory, Analysis, and Best Practices for Sigmoid Self-Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.082924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.082924Z digest=sha256:fe74b3375c0a9553e4d9a1b8e111af2fd831e31a8b2124b5c0196177b63ccdbe

Observation 415866f7-466c-4977-a643-b7911dea9cdb · outbound

This paper cites Shazeer, A.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Shazeer, A

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.793983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.087570Z digest=sha256:ca6402c4b6b2706542adcc2d027dd8bea3d7a139142db0b5d5606b3168aae26c

Observation 45f5aca0-f4ac-43fe-8be7-60ea9fe12926 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective LLaMA: Open and Efficient Foundation Language Models

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.091745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.091745Z digest=sha256:ba05cc73d65908e55811fc2534f388d572fe2bbdd5662c0f6de87d1555f3d8fc

Observation 361ce6d9-8ada-43f5-a50d-41c25448b45a · outbound

This paper cites van de Geer.Empirical Processes in M-estimation.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective van de Geer.Empirical Processes in M-estimation

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.780108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.095973Z digest=sha256:da129c67b92b27e4b771ecad007f5edf523c1c82f26ef0cf3ab0daab6dc54395

Observation 5a7d2c5b-9169-40d2-a67b-7d18cfeb4396 · outbound

This paper cites Vaswani, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Vaswani, N

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.765132Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.100075Z digest=sha256:4d2f2335649ee4bfdd2877b99eb0e564fd274592304bd4b7386c966b8c8c9d57

Observation 1c69072e-898a-4f23-bf1b-49ea75647eba · outbound

This paper cites Multi-Head Mixture-of-Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Multi-Head Mixture-of-Experts

Reference 48

Resolution
verified exact
local_arxiv, observed 2026-08-09T19:40:10.171584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.104099Z digest=sha256:0214316aa0e34804352e5782158b7a664d7bfdc677c3257ffe00c24b82f59a55

Observation 39cfab8e-90a2-4419-8c76-e23f39afd472 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.751070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.108506Z digest=sha256:167f7e5110f208bdc90d5cb49c10ebf5612a7cc3567d990003455eca430ff93e

Observation fc2b7f1a-0b9a-425a-a8a9-b788e2943258 · outbound

This paper cites SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.112733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.112733Z digest=sha256:c351b225051f866776a1c80b6348eb1c9ef5cc5505eed0789e6b4617ce77f73d

Observation 39ae668c-00e4-4f95-b16e-470717cc645f · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.736837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-09T19:40:10.117050Z digest=sha256:5f4ee9113e8ac0d5cfeee11316fb1111cb65c6c6bf6a7a2ac49518499bd77c72

Pith citing papers

Observation 74902ead-3577-4d01-9a87-7f7862c4d1c6 · inbound

SAGE: Shape-Adapting Gated Experts for Adaptive Histopathology Image Segmentation cites this paper.

SAGE: Shape-Adapting Gated Experts for Adaptive Histopathology Image Segmentation Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-03T20:49:18.282782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T20:49:18.282782Z digest=sha256:aa2380260f9c5899d1552971c33b6d9a9a9ef14526c6a2ba2ada3cbe3d619504

Observation 62cb4b34-ec64-48a5-a379-5011aaab5a53 · inbound

Integrated electro-optic attention nonlinearities for transformers cites this paper.

Integrated electro-optic attention nonlinearities for transformers Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-11T06:20:58.535002Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-10T17:40:50.396800Z digest=sha256:23e1a957de5d8a01f0219cf2d12d8197fcb45d3c04353e7d986508adad8ebd38

Observation f2b15b6b-1169-4598-853c-f53962355732 · inbound

Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models cites this paper.

Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 97

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T04:50:55.274953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-11T01:03:12.737706Z digest=sha256:2da182daa6b83c425319744047f81d8b12075d6c9b102aadb16c4a963f14108d

Observation a1ff76b9-ee72-4d8c-8925-53542b2ad83e · inbound

Efficient Implementation of an Adaptive Transformer Accelerator for Massive MIMO Outdoor Localization cites this paper.

Efficient Implementation of an Adaptive Transformer Accelerator for Massive MIMO Outdoor Localization Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-14T18:27:35.241620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-14T18:27:21.248464Z digest=sha256:cc17ed5e750089416b7097f7180406a80a6648c9fad900589eb32079a2842bb6

Observation 1b5517cb-1af4-4347-9199-1a246cf347ee · inbound

Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention cites this paper.

Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-07-03T09:57:56.073408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-06-27T10:18:40.938618Z digest=sha256:4a5108acf8433b7b39d6fa4562c72661dd1a214b906c74d5a532b3d90fbe2ecf