Paper Citation Record · LEDGER

Deriving Activation Functions Using Integration

As of 15 August 2026, this Paper Citation Record lists 28 of 28 outbound references and 3 inbound Pith citation observations for arXiv:2411.13010.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.13010 v3

Coverage vector

measured 28 of 28 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T17:01:30.758872Z

measured 31 of 31 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-10T10:23:35.895116Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-29T13:33:28.260781Z

Reference resolution

28 of 28 outbound references displayed

verified exact0
verified fuzzy22
unresolved6
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 085a548f-eb2b-499d-b120-70750e37048a · outbound

This paper cites Gqa: Training generalized multi-query transformer models from multi-head check- points, 2023.

Deriving Activation Functions Using Integration Gqa: Training generalized multi-query transformer models from multi-head check- points, 2023

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.246133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation ad4b8e30-0750-4470-b177-b78e8b47c307 · outbound

This paper cites and Li, Y.

Deriving Activation Functions Using Integration and Li, Y

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.229172Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a8b4b3c2-f86f-4667-b314-cbea1d7f35a8 · outbound

This paper cites Palm: Scaling language modeling with pathways, 2022.

Deriving Activation Functions Using Integration Palm: Scaling language modeling with pathways, 2022

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.213187Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d8309dc0-e704-4722-bf55-7b2acb148e2c · outbound

This paper cites Fast and accurate deep network learning by exponential linear units (elus), 2015.

Deriving Activation Functions Using Integration Fast and accurate deep network learning by exponential linear units (elus), 2015

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.196474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation ae229ab0-a4d1-46a7-aabe-1760223ad347 · outbound

This paper cites Sigmoid-weighted linear units for neural network function approximation in reinforcement learning, 2017.

Deriving Activation Functions Using Integration Sigmoid-weighted linear units for neural network function approximation in reinforcement learning, 2017

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.181288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation bcbb94a3-ed1e-4be1-9803-188414d6058e · outbound

This paper cites Scal- ing fp8 training to trillion-token llms, 2024.

Deriving Activation Functions Using Integration Scal- ing fp8 training to trillion-token llms, 2024

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.165270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 0e45832a-a6db-4f37-b8fc-96ae65cccd31 · outbound

This paper cites What every computer scientist should know about floating-point arithmetic, 1991.

Deriving Activation Functions Using Integration What every computer scientist should know about floating-point arithmetic, 1991

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.149388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation eae4b048-c1db-4d90-b899-97b283e82771 · outbound

This paper cites and Gimpel, K.

Deriving Activation Functions Using Integration and Gimpel, K

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.133065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6e31e274-9217-44be-801e-84d6e3642452 · outbound

This paper cites Minicpm: Unveil- ing the potential of small language models with scalable training strategies, 2024.

Deriving Activation Functions Using Integration Minicpm: Unveil- ing the potential of small language models with scalable training strategies, 2024

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.116709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 68a188af-43e4-4ddb-a47b-5aa1fdd41fc6 · outbound

This paper cites an unresolved cited work.

Deriving Activation Functions Using Integration Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-12T17:01:31.099509Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 07ef5619-f23f-4ad9-a727-ec44c2631b59 · outbound

This paper cites Self-normalizing neural networks, 2017.

Deriving Activation Functions Using Integration Self-normalizing neural networks, 2017

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.082160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a8337a17-8f08-4578-8f30-131281cbaf2f · outbound

This paper cites an unresolved cited work.

Deriving Activation Functions Using Integration Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-12T17:01:31.065244Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a1ed0811-f27c-481d-83fc-06b126eb998c · outbound

This paper cites and Hutter, F.

Deriving Activation Functions Using Integration and Hutter, F

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.048576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation b66dad30-660d-4844-926f-040330416e47 · outbound

This paper cites L., Hannun, A.

Deriving Activation Functions Using Integration L., Hannun, A

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:31.029573Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 0029b33c-08dc-417c-b33c-8f7caf29c043 · outbound

This paper cites an unresolved cited work.

Deriving Activation Functions Using Integration Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-12T17:01:31.013310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 64dd66db-9189-4497-bca2-34e33b6dc4c2 · outbound

This paper cites and Hinton, G.

Deriving Activation Functions Using Integration and Hinton, G

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.996255Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 8f1af36a-7b85-485a-9874-0b77ce7bb231 · outbound

This paper cites B., Lozhkov, A., Mitchell, M., Raffel, C., Werra, L.

Deriving Activation Functions Using Integration B., Lozhkov, A., Mitchell, M., Raffel, C., Werra, L

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.978525Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation bd28ad24-ebfa-4537-9902-6d3dbdaeb561 · outbound

This paper cites an unresolved cited work.

Deriving Activation Functions Using Integration Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-12T17:01:30.961842Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d47b43d3-9653-4545-858c-0fcdb0eb3b33 · outbound

This paper cites Glu variants improve transformer, 2020.

Deriving Activation Functions Using Integration Glu variants improve transformer, 2020

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-12T17:01:30.713892Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ec826a47-6468-4ba0-965e-adbac14254ab · outbound

This paper cites R., Mani, W., Liu, Y ., Dai, Z., Shleifer, S., Landolfi, N.

Deriving Activation Functions Using Integration R., Mani, W., Liu, Y ., Dai, Z., Shleifer, S., Landolfi, N

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.933738Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9c0717d8-e578-46d6-a32a-b9cb21e947f5 · outbound

This paper cites Roformer: Enhanced transformer with rotary position embedding, 2023.

Deriving Activation Functions Using Integration Roformer: Enhanced transformer with rotary position embedding, 2023

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.914666Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 3459e498-e493-4554-8dd9-87b600b1cc4b · outbound

This paper cites Going deeper with convolutions, 2014.

Deriving Activation Functions Using Integration Going deeper with convolutions, 2014

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.898578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 0c595cf1-a01a-40c8-8977-c41e858c1ce1 · outbound

This paper cites Llama 2: Open foundation and fine-tuned chat models, 2023.

Deriving Activation Functions Using Integration Llama 2: Open foundation and fine-tuned chat models, 2023

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.881525Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 505b1395-75a7-4af4-8e83-096ebfe7049f · outbound

This paper cites N., Kaiser, L., and Polosukhin, I.

Deriving Activation Functions Using Integration N., Kaiser, L., and Polosukhin, I

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-12T17:01:30.738585Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1e9ce687-9115-4bd8-be40-ded8eac97a15 · outbound

This paper cites Aggre- gated residual transformations for deep neural networks, 2017.

Deriving Activation Functions Using Integration Aggre- gated residual transformations for deep neural networks, 2017

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.850007Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation ac28d343-8d54-40cd-bc22-0ccbae9ff95e · outbound

This paper cites Scaling vision transformers, 2022.

Deriving Activation Functions Using Integration Scaling vision transformers, 2022

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.832438Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 14d8dab1-0351-4ec9-a237-7982911ac350 · outbound

This paper cites and Sennrich, R.

Deriving Activation Functions Using Integration and Sennrich, R

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.815646Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation ec013d05-6f4b-4d67-8840-42bddfeecf33 · outbound

This paper cites Relu 2 wins: Discovering efficient activation functions for sparse llms, 2024.

Deriving Activation Functions Using Integration Relu 2 wins: Discovering efficient activation functions for sparse llms, 2024

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T17:01:30.798602Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Pith citing papers

Observation a80d2963-692e-4b88-9c1b-c39d159fbfbe · inbound

An Engineering Journey Training Large Language Models at Scale on Alps: The Apertus Experience cites this paper.

An Engineering Journey Training Large Language Models at Scale on Alps: The Apertus Experience Deriving Activation Functions Using Integration

Reference 18

Resolution: verified exact; arxiv_id, observed 2026-05-10T14:20:30.869392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a22037c6-7087-444c-8b34-74ef647a9b86 · inbound

Apertus LLM Family Expansion via Distillation and Quantization cites this paper.

Apertus LLM Family Expansion via Distillation and Quantization Deriving Activation Functions Using Integration

Reference 7

Resolution: verified exact; arxiv_id, observed 2026-06-29T13:33:28.262494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation b548aeb2-ccf3-4dca-b77c-6e632a3f9844 · inbound

Is SwiGLU's Open Positive Tail Necessary? Evidence from Closed-Tail Gating with MemGLU cites this paper.

Is SwiGLU's Open Positive Tail Necessary? Evidence from Closed-Tail Gating with MemGLU Deriving Activation Functions Using Integration

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-10T10:23:35.895116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.