Pith. sign in

Paper Citation Record · LEDGER

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention

As of 12 August 2026, this Paper Citation Record lists 22 of 22 outbound references and 1 inbound Pith citation observation for arXiv:2507.07247.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.07247 v2

Coverage vector

measured 22 of 22 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:49:31.359221Z

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T13:12:14.575187Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T13:12:15.014269Z

Reference resolution

22 of 22 outbound references displayed

  • verified exact0
  • verified fuzzy3
  • unresolved19
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 6cf53606-8de5-4086-ab05-fb368b05af2e · outbound

This paper cites Gqa: Training generalized multi-query transformer models from multi-head checkpoints.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Gqa: Training generalized multi-query transformer models from multi-head checkpoints

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T18:49:32.184447Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-06T18:49:28.577361Z digest=sha256:0470355d40add268fe1cdd3426663f748043bc2aa67cd75a06f982f4671e5577

Observation 1533ce51-d99d-4c43-9ab5-aa7496a948fa · outbound

This paper cites Longformer: The Long-Document Transformer.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Longformer: The Long-Document Transformer

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:28.674929Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:28.674929Z digest=sha256:2dd37bd53ee1c0af7a75f877391ad1c6fe4f4b6322286acd2f5a0605072e9e2a

Observation 9f591f89-7700-418e-b8df-a1a3def8fc68 · outbound

This paper cites Language models are few-shot learners.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Language models are few-shot learners

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:28.795980Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:28.795980Z digest=sha256:2c94d323f2a8563a14b0b5401f0363a7fe6aee7b5f82df01aff353104edc1ac4

Observation 31842f1f-22df-4fa8-b928-36d054ac923a · outbound

This paper cites A Survey on Mixture of Experts in Large Language Models.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention A Survey on Mixture of Experts in Large Language Models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:28.926685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:28.926685Z digest=sha256:b7b46c24b2853929204dd0fcdd69e28909d010c69cc45319d20353f296cb7d42

Observation 00fe90b1-eca0-4fa8-bbed-96fef63323d3 · outbound

This paper cites Mistral 7B.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Mistral 7B

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:29.014289Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:29.014289Z digest=sha256:fb065dd65f5f66f612d9a5b260a84bc3dc03359aa92137927878ff9bd965d214

Observation e9a03435-44cf-4273-99ca-97cf53047db9 · outbound

This paper cites FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:29.131991Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:29.131991Z digest=sha256:3356c928fb4d125a52aac796b0205ec02ad595494832b20282776335a6fadec8

Observation b7405c27-eb12-49ec-8a28-95bf65de53e8 · outbound

This paper cites Lora: Low-rank adaptation of large language models.ICLR, 1(2):3, 2022.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Lora: Low-rank adaptation of large language models.ICLR, 1(2):3, 2022

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:29.340857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:29.340857Z digest=sha256:8548d44b3dc7d719c7f6afabc8ca7f10e4269a56c54ed344000ed2e3c6cdd8c4

Observation a8d00c93-1e0c-4328-8462-70dc040141a6 · outbound

This paper cites Scaling Laws for Neural Language Models.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Scaling Laws for Neural Language Models

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:29.476510Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:29.476510Z digest=sha256:360ad38ed08c21956af40d6b242656924d76e5fcc0471bada689ff1811190adf

Observation 755cb5cb-0c59-423a-86d6-f1eb0e9ca330 · outbound

This paper cites Transformers are rnns: Fast autoregressive transformers with linear attention.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Transformers are rnns: Fast autoregressive transformers with linear attention

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T18:49:32.038803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-06T18:49:29.571072Z digest=sha256:0169f446013bfecfba02b95bb882d4f132d0f4c50356b3f5ae32d64063c0197c

Observation 74e448d5-098f-47c4-882a-7e469cfa1ad3 · outbound

This paper cites Reformer: The Efficient Transformer.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Reformer: The Efficient Transformer

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:29.774607Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:29.774607Z digest=sha256:80bcc422c4fd47f4567d18c889aa39eb4b2538727ec3c74f5220e46679f68aa3

Observation be6113b3-f2d7-4b5e-a197-90b2e4be4697 · outbound

This paper cites Quantifying the Carbon Emissions of Machine Learning.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Quantifying the Carbon Emissions of Machine Learning

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:29.910594Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:29.910594Z digest=sha256:9b32e66d02a6b972aa2c352b3b4831e58150132d8a3055dc64db882e250c7f3b

Observation ffa8de1a-26bd-414b-b30b-80eefda2c3c2 · outbound

This paper cites DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:30.129660Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:30.129660Z digest=sha256:11d057cd3dd365874caebc3f19ad05b83984b6993980e057ddb11b7d44a18f14

Observation 70ab1e9f-5c2c-4333-b7f7-16a8554a145c · outbound

This paper cites Effective Approaches to Attention-based Neural Machine Translation.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Effective Approaches to Attention-based Neural Machine Translation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:30.250557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:30.250557Z digest=sha256:cbaa5e667785afd37b465999f6c209a87f986f20d1c02d0e3391c4cb12d639e1

Observation ed3808c3-76ac-4ea5-afe4-27c6cf5c273b · outbound

This paper cites Carbon Emissions and Large Neural Network Training.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Carbon Emissions and Large Neural Network Training

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:30.411057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:30.411057Z digest=sha256:1b4fc174e53aeebc72eaf28bada5fb699398d71f71a95ff4e02718e21abdc7c7

Observation c4370051-ebf6-4773-af57-522149c7b46d · outbound

This paper cites Language models are unsupervised multitask learners.OpenAI blog, 1(8):9, 2019.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Language models are unsupervised multitask learners.OpenAI blog, 1(8):9, 2019

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:30.548924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:30.548924Z digest=sha256:a27ed8406b5586020ad89c901c8b9ede8b1baa5d03d1d13daca8a775bb604420

Observation 79f30ed3-99bb-44da-94ba-d70040ed9d57 · outbound

This paper cites an unresolved cited work.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:49:31.864535Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-06T18:49:30.637719Z digest=sha256:17b663755e09cbafb5855c604a98f41c9cea9fdb044ee5d932da73573d520e49

Observation 1992ae56-455a-401c-8403-ae7e2edc3a7b · outbound

This paper cites Green ai.Communications of the ACM, 63(12):54–63, 2020.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Green ai.Communications of the ACM, 63(12):54–63, 2020

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:30.803553Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:30.803553Z digest=sha256:02be5fff8034d772e3bbd09f531ad8114c9d5340caec4976267b79d1b98eb53c

Observation 842477b6-8365-401a-8968-9eee0eaeaadb · outbound

This paper cites Energy and policy considerations for modern deep learning research.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Energy and policy considerations for modern deep learning research

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T18:49:31.688398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-06T18:49:30.906531Z digest=sha256:b2bf7abe45470bc850153207f9eb9e6dad0d645a29a3d35ef861cbcfa21d3c44

Observation 9220446c-df68-4ee6-9ed7-bd9ba74ea654 · outbound

This paper cites Efficient transformers: A survey.ACM Computing Surveys, 55(6):1–28, 2022.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Efficient transformers: A survey.ACM Computing Surveys, 55(6):1–28, 2022

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:31.036877Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:31.036877Z digest=sha256:320b67072078a158c75e693429238672c53514312bde49814dd69ef5f0ea5296

Observation 3ae101e6-33f7-4f5b-84f9-7d2e3cfcdf37 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:31.167414Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:31.167414Z digest=sha256:760da1167b303a161685f293d11cfd04b440cbecc4ba4425b0fcb333e72bef33

Observation 6d1c79d3-7965-4a30-adfe-fdf4735c951a · outbound

This paper cites Attention is all you need.Advances in neural information processing systems, 30, 2017.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention Attention is all you need.Advances in neural information processing systems, 30, 2017

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:31.296532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:31.296532Z digest=sha256:1fb0baa91a3e141a0bb08df1e9f5317d2cec6858d7b6ae62659ae242331efc4b

Observation e91dfe5c-f852-4e72-9476-8c90bf24d91f · outbound

This paper cites A Survey of Large Language Models.

Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention A Survey of Large Language Models

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T18:49:31.359221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:49:31.359221Z digest=sha256:8bd659631376e4c56f17d2959b62aa5c460ac7b0fd41a7c9d30ba13c0d12a248

Pith citing papers

Observation ffbc3d9f-18f9-45bd-84f3-2e2dc29befe4 · inbound

TinyMusician: On-Device Music Generation with Knowledge Distillation and Mixed Precision Quantization cites this paper.

TinyMusician: On-Device Music Generation with Knowledge Distillation and Mixed Precision Quantization Attentions Under the Microscope: A Comparative Study of Resource Utilization for Variants of Self-Attention

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:12:15.021355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-08-05T13:12:14.575187Z digest=sha256:9ba5a441b700a14f455246ef77577d0d6c700831f6e038d21dbb2a29ee4edc2f