Pith. sign in

Paper Citation Record · LEDGER

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

As of 10 August 2026, this Paper Citation Record lists 51 of 51 outbound references and 5 inbound Pith citation observations for arXiv:2502.00281.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.00281 v2

Coverage vector

measured 51 of 51 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T19:40:10.117050Z

measured 56 of 56 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T20:49:18.282782Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T09:57:56.071813Z

Reference resolution

51 of 51 outbound references displayed

  • verified exact1
  • verified fuzzy19
  • unresolved31
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e8120a2f-1ed4-4b27-a28e-bd9d932542bb · outbound

This paper cites Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.900330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.900330Z digest=sha256:22924fa69b076684302025e21ebbdfd6ef4207f2672bf4faeca0ed7cc6f3853f

Observation c8d8891a-f976-44ad-8f0d-71c3911bb9f6 · outbound

This paper cites Brown, B.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Brown, B

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.203351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.905517Z digest=sha256:ed71a2cfc19f460bdbbd9c9b62c3f4c7f5a888ee0bf606405f6270303970cd98

Observation ab4d4468-b600-4c27-98a4-acc42eef12ad · outbound

This paper cites Carion, F.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Carion, F

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.190297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.910208Z digest=sha256:5f3dd87acffff5028628a18d90bc21e798ca161912544d25b0a97ce1396ae248

Observation 10bba22e-00dd-44fc-8f03-aeabe3451f3d · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.177037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.914886Z digest=sha256:c6988427f01aa0abf8e6421ef601926ddecc7402aeba2eda4d883b4e2eb90189

Observation f0ffd833-082e-4733-997e-b698dcc0f59b · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.163315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.919331Z digest=sha256:52c54e8f5dac524a46ff3648029f566bf94bafe228c0959c8eeffec090b67b75

Observation ae242085-d1c6-42e9-a732-924c497e3b57 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.150009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.923873Z digest=sha256:2d8563cceda5fc39c9126ae4241f88dc24f36da594a2405f6ef3fcdf22b171cb

Observation 54a17dd1-0fea-454a-b6e9-5fe9fb1fe11a · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.136890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.928662Z digest=sha256:ac72b672c2b44dc6a5e3786ae6394d500948b036b1afee991e20a784be6016d0

Observation cf36eb1e-0b80-44d1-88ad-859c22423932 · outbound

This paper cites Csordás, K.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Csordás, K

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.123287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.932953Z digest=sha256:ac09e2d4f26c7e82c5707a6eff0eabf0c8ac522944723f48d4d1f3a3cc5e3a9e

Observation e45bede9-6c9d-4f26-ad44-2b34d4e07e10 · outbound

This paper cites SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.937100Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.937100Z digest=sha256:f063f5a576ceebc58889783b256c9a4fe057f238f75ab36b71eb58cc44205291

Observation 43abca66-ad71-4c7e-97b7-77b8e897c22c · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.109063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.941678Z digest=sha256:9ed15efc425d85b43916c1af4c4b6e8c156a213b743eb033d7555fe0dbe64033

Observation d1b3f20a-c2fd-435f-ba94-91f6aefc0470 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.094932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.945761Z digest=sha256:e02fda58cc2216a772e59137deed895993c53c69a85f13142902ffbebfdfc933

Observation fa7dafaf-4d6b-46be-baf8-2b81dce23543 · outbound

This paper cites DeepSeek-V3 Technical Report.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective DeepSeek-V3 Technical Report

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.950221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.950221Z digest=sha256:79549c5733007eaa72ad2964611eda210bad2807dbaf1c2d98e3d909319aedd9

Observation 253386c7-9ee4-41f6-bb58-3b149a922e74 · outbound

This paper cites Devlin, M.-W.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Devlin, M.-W

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.080979Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.954822Z digest=sha256:89cf2a3aea54e02978d8e2f258729de600eabcc04fb2217676ff1ebb7ae0df53

Observation d087c60a-ee86-406f-a0b7-7b7b0a1725e2 · outbound

This paper cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.958925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.958925Z digest=sha256:178a920818d8b1870e68d6aebf3429d5582ce6f8256204883d924f68481e78b3

Observation 676de2a8-a1a3-4c58-a6d7-c0899e021e64 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.067577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.963234Z digest=sha256:e7de0fcb9c060f105de295107ae5db69ee65d64156dbed859b3de4253a05bad1

Observation 599fd6a8-175d-4b02-8c68-7a0bdd711742 · outbound

This paper cites Faria and G.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Faria and G

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.054095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.967335Z digest=sha256:a43eabfae21ebf0e25f3bac9d68e4ddcc1e671802e942c342e66fccfa92a497b

Observation 6e5711a7-2217-4e2b-a1a0-c18ff6caa360 · outbound

This paper cites Fedus, B.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Fedus, B

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.040919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.971313Z digest=sha256:fc788341b523621e7d523ad9f15bcb73bdbab18806159d972ea5fa3d3db514bc

Observation db5d1512-5d0d-431c-94ef-e6f6823b6a38 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:11.027620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.975323Z digest=sha256:b3273365eda0993ed83db9a848a0b3fcf5593776b8e744fc34ff1e6693847521

Observation 94040920-2a3c-4ba5-8fdc-c71943b91d03 · outbound

This paper cites When Attention Sink Emerges in Language Models: An Empirical View.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective When Attention Sink Emerges in Language Models: An Empirical View

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.979304Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.979304Z digest=sha256:8d4e42f225103ef03d031d75bb50177412ed5f0ebe8349dfbff9e02083794810

Observation 5f986ff3-09af-4868-9ebb-81821c2c1630 · outbound

This paper cites Hazimeh, Z.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Hazimeh, Z

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.014277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.984123Z digest=sha256:7143ffefe3637d9d28b1b0edb24b3e42aba628407887ea7c88f117ed268549a7

Observation bd3c8fad-4ea1-4be6-a400-ced16f5f9f9d · outbound

This paper cites Ho, C.-Y.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Ho, C.-Y

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:11.001140Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.988056Z digest=sha256:939fddc769deee9f81de1bd7387f756b4bb475f6a3262cb4a78ddb227d954f8e

Observation 6161a011-10e8-4898-a37e-5bc640160320 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:09.992027Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:09.992027Z digest=sha256:b7c1118ea7703ba717f3441ef9971da7d20678f5075a5332bb0d49758d3e34ee

Observation 538213f1-c24a-4f17-bbc8-671ad2be8eef · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.987525Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:09.996131Z digest=sha256:4a97a8aef3893d3aa27af84b2c3f4eb798f3988c941c3dc8aafc51fd2fc5e2bb

Observation 74f79a52-ec75-4a5c-826f-5f4a8271b756 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.974348Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.000145Z digest=sha256:9950928cd9b2391809ee1f022d390317feaf9ab28e8f2a7f47e6ad51d07180e9

Observation 98d8873a-e043-433d-85a5-673f82117a78 · outbound

This paper cites Mixtral of Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Mixtral of Experts

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.004105Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.004105Z digest=sha256:c69481d1f276c675706686427b8776b276c1379a8128dbbb83e24644a79b6469

Observation bc98eb83-21b7-4899-8753-b55aa7e3fe1c · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.008682Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.008682Z digest=sha256:c0953eec8e330a7ec4a724fda0cd13c2c96bc5ec41bba73faad25b33f0168795

Observation 968242c1-feda-412c-b867-0bc959ae2c0b · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.961009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.012895Z digest=sha256:e838e7aab715e213984fddc03ce87a82a83a5d8e74f992c94a3d7fa93e8de4f4

Observation 2809a598-64be-4929-b590-d4fc542cf60b · outbound

This paper cites Preference Transformer: Modeling Human Preferences using Transformers for RL.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Preference Transformer: Modeling Human Preferences using Transformers for RL

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.017433Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.017433Z digest=sha256:3396b1a824e4128f5708dae57f4c54397a3f5fc7a50d7d785ad1ce6e1fc224fc

Observation 26154118-9089-4458-97a9-ec9b9e392146 · outbound

This paper cites Kwon and S.-W.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Kwon and S.-W

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.947431Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.022054Z digest=sha256:bfef3af8eb6f3d71436cfd259303da051af493edbec6f2c3e70cbd538bf29397

Observation 8c1220ec-2af6-4db9-af5f-a9a9b87b42bc · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.934201Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.026196Z digest=sha256:08c5a720295cad4d4975af8af7e7a406cddd1160f2f0d910fae1052d414e572b

Observation b6ab5a69-e223-4325-bc4d-737676593977 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.920938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.030423Z digest=sha256:94c34ffd0eb632a07064ee4d8ad45e44a7567bc5a98c37486fa23ec784baf68c

Observation eaad19f3-c0ac-42c3-9944-674c11baa8d1 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.907333Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.034812Z digest=sha256:e19f95232b07417da88d4e0211ef2c2a604cd47aad0fecea90feaf36e138a868

Observation 80e2ac64-eebf-441c-8ea6-aa3007049d4c · outbound

This paper cites Manole and N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Manole and N

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.893918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.039164Z digest=sha256:a679d9f132f154f346c2b818b6c2e13f41b2657bfabaa972f5c6970c002819ef

Observation 6a9355de-8d42-45e6-938a-9fc09e2c4049 · outbound

This paper cites Convergence Rates for Mixture-of-Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Convergence Rates for Mixture-of-Experts

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.043497Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.043497Z digest=sha256:a814f9d7495a1d9fba45f1fcc267c3dd4b39c6f3e5f3ff5a87c42ba3058f720e

Observation 71feb4ba-a7e5-46a1-9945-9ceb7a7c5eab · outbound

This paper cites OLMoE: Open Mixture-of-Experts Language Models.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective OLMoE: Open Mixture-of-Experts Language Models

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.047855Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.047855Z digest=sha256:eb24640b73cbe1f33c421c4de256f568e5864fd3b4b67c8fdc86e89b974d3b56

Observation ab56543d-cac9-4b9e-be45-9a0e599f7307 · outbound

This paper cites Nguyen, P.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, P

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.879965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.052583Z digest=sha256:c7fc339a0c9201b45100f003c1eb0060074d3e64ef6a2c0ef64010e92ec08926

Observation baf56675-9f9b-45f7-8540-65b729d3bb66 · outbound

This paper cites On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective On Expert Estimation in Hierarchical Mixture of Experts: Beyond Softmax Gating Functions

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.056730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.056730Z digest=sha256:7367c2d60362364a4bce867e247708e0e0fdcccf4fa9fbe067977ce272e2f59a

Observation 6178e07b-b68c-43de-8d2f-3c8027c7b27f · outbound

This paper cites Nguyen, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, N

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.865963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.061063Z digest=sha256:5a1ecb411fcf70f7f1932bfebff827b8a04c331f3b31a6baee227d449be32e02

Observation e3a0f99e-2ecb-428b-9498-90a9b789db58 · outbound

This paper cites Nguyen, T.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Nguyen, T

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.851697Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.065429Z digest=sha256:93baac3d36d214d2336bf09cc31bc64ee234b0438c396a3dc7f599feb0098a3c

Observation 30a20f9a-c936-4ee9-a8e3-552c09ce2cfa · outbound

This paper cites Puigcerver, C.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Puigcerver, C

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.837621Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.069969Z digest=sha256:656efbe58babfa70ebcd585e1419994b62b57a19692c538a9ed47fe055b442b7

Observation c65e66c5-abe5-4307-b1ff-9a324a67e769 · outbound

This paper cites Radford, J.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Radford, J

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.823953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.074169Z digest=sha256:506767f9f7d2279bcd8799b14301eb27fb5f17ee5ac9338cc93d36ec1ab2989c

Observation 07cf5d11-6c29-4bff-b1d7-cee2ebcd2739 · outbound

This paper cites Raffel, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Raffel, N

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.809871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.078721Z digest=sha256:a9767b256ed39d93a4811ba8e8dcd9abad8a5ba98dc3827548cfd73970612ab8

Observation 83fe0c0b-b786-43e1-a462-f18671deb5dd · outbound

This paper cites Theory, Analysis, and Best Practices for Sigmoid Self-Attention.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Theory, Analysis, and Best Practices for Sigmoid Self-Attention

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.082924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.082924Z digest=sha256:46e79b6cccc612fd30cd65a934ca1822c748c7348538ce6aafe3ab9e2d0c86dd

Observation 415866f7-466c-4977-a643-b7911dea9cdb · outbound

This paper cites Shazeer, A.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Shazeer, A

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.793983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.087570Z digest=sha256:c9c05b6d850f52b03ea612e1e44e4123c90882752db8bd4234a6f6b57a706a8a

Observation 45f5aca0-f4ac-43fe-8be7-60ea9fe12926 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective LLaMA: Open and Efficient Foundation Language Models

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.091745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.091745Z digest=sha256:4900e05abfd9c066105099cdb1007458a9d090165952df13f289106635e28f36

Observation 361ce6d9-8ada-43f5-a50d-41c25448b45a · outbound

This paper cites van de Geer.Empirical Processes in M-estimation.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective van de Geer.Empirical Processes in M-estimation

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.780108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.095973Z digest=sha256:21475dcbf32b6baccb79d8bd40c69be7fbbbcee9e70bc2a30478422131394b1f

Observation 5a7d2c5b-9169-40d2-a67b-7d18cfeb4396 · outbound

This paper cites Vaswani, N.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Vaswani, N

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T19:40:10.765132Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.100075Z digest=sha256:71b39a5fb5b86157068f61b482bf561c8895a59ecbdc179d2a5aac58c809f9f0

Observation 1c69072e-898a-4f23-bf1b-49ea75647eba · outbound

This paper cites Multi-Head Mixture-of-Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Multi-Head Mixture-of-Experts

Reference 48

Resolution
verified exact
local_arxiv, observed 2026-08-09T19:40:10.171584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.104099Z digest=sha256:71c1b81f297569a627fc48f83e9ca70424568f381f26d4ddea6252e7afadce58

Observation 39cfab8e-90a2-4419-8c76-e23f39afd472 · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.751070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.108506Z digest=sha256:a75967adc25f9ee64ecde5f1bd310e9054882a8477c80e2d3cb6b1781c3f3f29

Observation fc2b7f1a-0b9a-425a-a8a9-b788e2943258 · outbound

This paper cites SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-09T19:40:10.112733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T19:40:10.112733Z digest=sha256:8fd246f7493e17e21111baf2b9af99771055d0bb0215e924b2e01ddd49adc883

Observation 39ae668c-00e4-4f95-b16e-470717cc645f · outbound

This paper cites an unresolved cited work.

Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-09T19:40:10.736837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T19:40:10.117050Z digest=sha256:54f14820e89cfd8613aedb295ffc45ae8eacedbc9aee48fd559ced55e52c6aa2

Pith citing papers

Observation 74902ead-3577-4d01-9a87-7f7862c4d1c6 · inbound

SAGE: Shape-Adapting Gated Experts for Adaptive Histopathology Image Segmentation cites this paper.

SAGE: Shape-Adapting Gated Experts for Adaptive Histopathology Image Segmentation Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-03T20:49:18.282782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T20:49:18.282782Z digest=sha256:652a7ec0c16e5907eeaa5f9ea5e925141ac807ad195f1782fee55788b254aefa

Observation 62cb4b34-ec64-48a5-a379-5011aaab5a53 · inbound

Integrated electro-optic attention nonlinearities for transformers cites this paper.

Integrated electro-optic attention nonlinearities for transformers Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 12

Resolution
verified exact
arxiv_id, observed 2026-05-11T06:20:58.535002Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-10T17:40:50.396800Z digest=sha256:200b29291b7798b78314f9307ad770e3108eb96f0d7a25634e3afcc7b34d3d13

Observation f2b15b6b-1169-4598-853c-f53962355732 · inbound

Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models cites this paper.

Convergence Rates for Latent Mixing Measures in Infinite Homoscedastic Location-Scale Mixture Models Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 97

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T04:50:55.274953Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=arxiv_source observed=2026-05-11T01:03:12.737706Z digest=sha256:a0ecf5ff9d3e656b011c99f32e8c8866e1788dcf8af38e48af32efb0cb24471e

Observation a1ff76b9-ee72-4d8c-8925-53542b2ad83e · inbound

Efficient Implementation of an Adaptive Transformer Accelerator for Massive MIMO Outdoor Localization cites this paper.

Efficient Implementation of an Adaptive Transformer Accelerator for Massive MIMO Outdoor Localization Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-14T18:27:35.241620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-14T18:27:21.248464Z digest=sha256:6444fefebe50cbba65bb9ec67429984b974347b1b4044818c7004f7205c4f135

Observation 1b5517cb-1af4-4347-9199-1a246cf347ee · inbound

Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention cites this paper.

Boltzmann Attention: Learnable Ising Couplings for Cooperative Attention Sigmoid Self-Attention has Lower Sample Complexity than Softmax Self-Attention: A Mixture-of-Experts Perspective

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-07-03T09:57:56.073408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-06-27T10:18:40.938618Z digest=sha256:74ff0ea964e29f7749e83784e5dc3eed24bf5f70d9b448314ed6005b2788bc81