Pith. sign in

Paper Citation Record · LEDGER

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization

As of 7 August 2026, this Paper Citation Record lists 50 of 50 outbound references and 0 inbound Pith citation observations for arXiv:2607.07678.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.07678 v1

Coverage vector

measured 50 of 50 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-09T02:52:28.852922Z

measured 50 of 50 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

50 of 50 outbound references displayed

  • verified exact7
  • verified fuzzy39
  • unresolved2
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 1694792b-e549-4aba-b9d3-5d02733aaaad · outbound

This paper cites Alabdulmohsin, Vinh Quoc Tran, and Mostafa Dehghani.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Alabdulmohsin, Vinh Quoc Tran, and Mostafa Dehghani

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.892857Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:bf2616b05f7275c322e51f6fd4ba01339436fcdad904e19755ba67a20414d6b2

Observation 0ce85a18-55d6-4b94-b8ff-326507bd9a14 · outbound

This paper cites Neural machine translation by jointly learning to align and translate.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Neural machine translation by jointly learning to align and translate

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.832797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b8c91a6eb418aa3f46fa09130e0a2ff2cca9589c8d4eee643559b0f0e26375df

Observation 7063f56a-3c4d-4bd3-9053-34bb55f5ba5e · outbound

This paper cites Round and round we go! what makes rotary positional encodings useful? InICLR, 2025.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Round and round we go! what makes rotary positional encodings useful? InICLR, 2025

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.856586Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:1581dc8aef4b41ea39c4a6511d992e2a8cc1f87e0f81c720d8b8101c8b6c8c96

Observation da561eac-8b08-41aa-8b20-b3d4756f7c61 · outbound

This paper cites Relational inductive biases, deep learning, and graph networks.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Relational inductive biases, deep learning, and graph networks

Reference 4

Resolution
metadata mismatch
local_arxiv, observed 2026-07-09T02:55:53.505422Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:91c379191c83bbfda7b66b6ed1ad067c7096be60f7ddf97fbb321a92fbf1f8aa

Observation 04ff8185-920b-4cf7-9be6-17d86a28ebbe · outbound

This paper cites by Parts.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization by Parts

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.846895Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:74e1e19f84258cda43eec76aa45af25021830ed42e6bb12ef6dfca52e9995315

Observation ece55931-732c-4909-96b3-f24412798e09 · outbound

This paper cites NTK-Aware Scaled RoPE Allows LLaMA Models to Have Extended (8k+) Context Size Without Any Fine-Tuning and Minimal Perplexity Degradation.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization NTK-Aware Scaled RoPE Allows LLaMA Models to Have Extended (8k+) Context Size Without Any Fine-Tuning and Minimal Perplexity Degradation

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.845011Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:31e62ba0f70d648ca6683e8d46664b5885490c9dc7960bb678501e51681118db

Observation 29d6936a-fe67-4fc3-a44e-5fab0b4cf375 · outbound

This paper cites Extending Context Window of Large Language Models via Positional Interpolation.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Extending Context Window of Large Language Models via Positional Interpolation

Reference 7

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.504805Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:d3451525a6ae320cf34b62ce59bfdff98fe3a8d0f71d6c7bbe72b8f5d6f0cb52

Observation 841f58c6-d6fb-49c7-96e8-417e11025cc0 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Training Verifiers to Solve Math Word Problems

Reference 8

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.520293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:2b28432237eb50d3d04856b47891b22e1c725326bd437f1d258a046f28a2b70e

Observation 90fbd041-b348-4dd2-8ec7-42a983133588 · outbound

This paper cites Nemotron-CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Nemotron-CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.507969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:90154b98cbec495c15ec5181da7e51534962d88126b650c215092f0ba8a58ada

Observation ba26b5e8-bba0-4e5a-8247-860db6e21584 · outbound

This paper cites Dynamically Scaled RoPE Further Increases Performance of Long Context LLaMA with Zero Fine-Tuning.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Dynamically Scaled RoPE Further Increases Performance of Long Context LLaMA with Zero Fine-Tuning

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.850561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:bb363f82ceb12244c9e8920c0454a6109e3fc70c8c7b870e2ee032779c799d61

Observation 8dd77c53-abfc-460f-8cfb-1a8a671423b9 · outbound

This paper cites What is Wrong with Perplexity for Long-context Language Modeling?.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization What is Wrong with Perplexity for Long-context Language Modeling?

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.525674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:3ad21d2e44d44e862a9a7e5d73a1fc9928f3315362a23a49fec9806a3eaff952

Observation 7ac5d788-9e4a-46dc-9fc9-228b099904e7 · outbound

This paper cites Rethinking invariance in in-context learning.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Rethinking invariance in in-context learning

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.887524Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:2319ebc5e307b6bfbce99781561642f9a0753e636fece795f4bf3d2321f350a1

Observation 32be4c5b-cf09-41e6-941a-34772186d023 · outbound

This paper cites When attention sink emerges in language models: An empirical view.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization When attention sink emerges in language models: An empirical view

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.885655Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:e944c735f045ae9ce45913295b603c5184e7a84d6af92300058b44272dbd6afa

Observation 5ec052e8-682c-46ed-a97e-02913556d7f2 · outbound

This paper cites Serial position effects of large language models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Serial position effects of large language models

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.840929Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:3b96f2371d6122a4a14b22c32e82f4f053ab7e377e57038079f94e51c20da4a7

Observation 728d0568-2d93-421b-a4de-01ed6c854ef5 · outbound

This paper cites Large language models are zero-shot rankers for recommender systems.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Large language models are zero-shot rankers for recommender systems

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.834878Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b85dfe95c65a35c9c3e07c1d37cdb1c960823829b460c68751dec721266716f3

Observation 25934c14-3821-4bbf-bade-07ff0e251fd3 · outbound

This paper cites Fourier position embedding: Enhancing attention’s periodic extension for length generalization.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Fourier position embedding: Enhancing attention’s periodic extension for length generalization

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.839036Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:77dfef8c85c760f90e21d2ee309d11331809e5f85fc12b1ff2647e7368f1b244

Observation ace7169e-fb47-49d3-a124-20a099e71fc9 · outbound

This paper cites Massive values in self-attention modules are the key to contextual knowledge understanding.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Massive values in self-attention modules are the key to contextual knowledge understanding

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.852489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:447c972ac7464d3272bc44db9a2ff984cb3e0b65e502f15cb12f890c1546689f

Observation 638eb450-fd9a-4808-a077-c2924b0cd87b · outbound

This paper cites nanochat: The best chatgpt that $100 can buy, 2025.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization nanochat: The best chatgpt that $100 can buy, 2025

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.854554Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:85ac782b708dbb61fa6ef4f8aedaffc7fe0d634ae2a0665cc0b085d225e7cb74

Observation 77ad794b-56ea-4d7d-9f77-dcfce9301e61 · outbound

This paper cites The impact of positional encoding on length generalization in transformers.Advances in Neural Information Processing Systems, 36:24892–24928.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization The impact of positional encoding on length generalization in transformers.Advances in Neural Information Processing Systems, 36:24892–24928

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.883743Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b8ad3398c21ab5924e67a39da02b2fcff2fc869a5389af2bc645f4f6769ee3ab

Observation e227fe76-e5bf-46a5-acf9-8619a88bdcce · outbound

This paper cites an unresolved cited work.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-07-09T02:55:53.835870Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:ee4f2613271ae29d66196307dc6facba1b9f74389b3041de094414827e13eefd

Observation 23e0c57e-3b2a-41a8-b1fb-ace95c02c96b · outbound

This paper cites Mutual information functions of natural language texts.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Mutual information functions of natural language texts

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.881592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:07b7d696ae83ebd22daa9717fbfec5f1e5156d8da5985fa8a394dbcc65321014

Observation 857c26ca-5e7d-4140-8c44-9d094a04b7d2 · outbound

This paper cites Lost in the middle: How language models use long contexts.Transactions of the Association for Computational Linguistics, 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Lost in the middle: How language models use long contexts.Transactions of the Association for Computational Linguistics, 2024

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.842923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:668d40e4497cd68107aed0a67ad0cce84d6bd775b35441b27d9577f4bdcef72b

Observation 39746906-d9dd-4804-b07d-49803647a185 · outbound

This paper cites Decoupled weight decay regularization.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Decoupled weight decay regularization

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.860391Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:a1eb64f2ad56bbac5314db2caf690848686376f58d3e8c00fd148c3d60c25fa1

Observation db667a91-1eed-4dd4-8553-6631b722052a · outbound

This paper cites Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Fantastically ordered prompts and where to find them: Overcoming few-shot prompt order sensitivity

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.900093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:e9bcd7578dde3b274f40c478457f8762e26f4ba73f6a28ab5a21bd625bda737c

Observation 77336fae-c8fc-4f5f-b32e-6f2089c1964c · outbound

This paper cites Base of rope bounds context length, 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Base of rope bounds context length, 2024

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.879676Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:d87cf35dda9ee258b00a811a5aae3f12529877140128535a47f127fc247bf188

Observation 3bfab21b-c9c0-4a61-a6f0-62e1913da9ab · outbound

This paper cites Note on the bias of information estimates.Information theory in psychology: Problems and methods, 1955.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Note on the bias of information estimates.Information theory in psychology: Problems and methods, 1955

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.870307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:c3c434492a2474240cc9adf87fa0793d2fb9cf4902b0b72dcbb3c8880248441e

Observation 17271e25-aa14-4e9f-8ed3-e09180f598ee · outbound

This paper cites Rethinking the role of demonstrations: What makes in-context learning work? InEMNLP, 2022.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Rethinking the role of demonstrations: What makes in-context learning work? InEMNLP, 2022

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.864263Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b2d90d69dbad669cad2ee779b10984662348ba086c96f6a5ff3298ef49cfefea

Observation c401083d-0136-4980-9599-db737b126952 · outbound

This paper cites Mitchell.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Mitchell

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.889207Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:61b5e7f46b6c38b20afadc5708e712eb2f98b17fe0a57dad2fdc0753e6e76ead

Observation 8e626207-c5b8-4f20-ab68-ecde5be4822a · outbound

This paper cites Frequency bands in roPE: Base frequency and context length shape the interpolation–extrapolation trade-off.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Frequency bands in roPE: Base frequency and context length shape the interpolation–extrapolation trade-off

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.866397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:6c8a1c37b6c2d4dead0cd56987c97c65d9d92a3a1dba9ed9a172a23e8872e7f0

Observation 780a16b0-ecb2-4ff2-aa74-996b8603f274 · outbound

This paper cites In-context Learning and Induction Heads.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization In-context Learning and Induction Heads

Reference 30

Resolution
metadata mismatch
local_arxiv, observed 2026-07-09T02:55:53.510704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b91a108103718823681711ebe24724db5f426ffbe8c0cb0088969545074e7b89

Observation 6290b305-bd55-4ba2-9b21-8af38392101e · outbound

This paper cites Yarn: Efficient context window extension of large language models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Yarn: Efficient context window extension of large language models

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.868302Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:e9c23601f4f38c64cb2d6147f8d47254d594021344b114790c6fa13d39e0e816

Observation e0125542-9c0d-40c7-bde6-5ddda5db775d · outbound

This paper cites The mechanistic basis of data dependence and abrupt learning in an in-context classification task.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization The mechanistic basis of data dependence and abrupt learning in an in-context classification task

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.830788Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:0d911bbfba919cc5429e45f1186adc43164189d087235fc5a3e2184bde0ac09f

Observation 91a0ecef-7c38-4d91-972a-6051c2c9b561 · outbound

This paper cites Roformer: Enhanced transformer with rotary position embedding.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Roformer: Enhanced transformer with rotary position embedding

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.877800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:d73afb9af3501a94557412a9517a6a984de2c5027837812acbb759d95b7eebe2

Observation e200f095-8e72-49de-bc06-c7ddd1d4131a · outbound

This paper cites Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.874127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:f97e2ddd0e7fd9d5e837e8d5fdf9b5f59f21b811c7bbb7c82d0417421f47d667

Observation 0736f869-6dc4-4a67-91a8-b90208155d68 · outbound

This paper cites Hashimoto.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Hashimoto

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.828734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:8ba26cc6fa4a25eafd12597175c35dd0404ef95899bdf95cf35cafcfaf49bb52

Observation 9c32bdf4-720b-4310-8de1-84a059ce7b72 · outbound

This paper cites Qwen2.5: A party of foundation models, September 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Qwen2.5: A party of foundation models, September 2024

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.872324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:9c645100de310372a4e03488e0ee3fd61dd6b6a96d8fbc1dc242e34ef85ad181

Observation 21bfe6b3-c7f1-45a9-a4c9-7b154b3b257d · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization LLaMA: Open and Efficient Foundation Language Models

Reference 37

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.517990Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:8f8ccf8aedb481d284a34c3e8d342c9c3457c542bc907e0ba99e225c25aa139a

Observation bfadd9d9-c3e1-4886-97dc-fa7d42b95913 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 38

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.523024Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:f90ce4384f2a1b84035fbbfcc62e923920510160a71758aa2b888b9030d133b3

Observation 2574888a-590e-444c-b904-b02ce971fbeb · outbound

This paper cites Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.875850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:b2d77cc853c6219655fe8a304073056dce348c1788003d05806f5ba64530137a

Observation b5514cb7-9d29-4b4a-b2de-397ce211dfba · outbound

This paper cites Kakade, Hao Peng, and Heng Ji.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Kakade, Hao Peng, and Heng Ji

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.891012Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:2252a18f8de2d1ca8d24a45eb4b48488a51be0625d0a9a37611086f15b055d03

Observation a300dc53-d92f-4f2e-a137-b76537a25550 · outbound

This paper cites an unresolved cited work.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-07-09T02:55:53.858476Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:fd3de0ba45b309fde71bf09ec0b58ef481ff60d6379483e7c872e757eed5fa99

Observation 53e2db8a-040b-402a-b8e8-499e3f8ff9b5 · outbound

This paper cites On the role of attention masks and layernorm in transformers.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization On the role of attention masks and layernorm in transformers

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.862252Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:06183300faad2a6eccfc026361c0d1fb5902c0b4dc46fcb20dd3398637c86027

Observation 1a3f7d3d-68b2-4bcd-a516-6d78c2c04165 · outbound

This paper cites On the emergence of position bias in transformers.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization On the emergence of position bias in transformers

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.894668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:96026d650ec0297abc739879b89e6cf8f65fa77a746505ef687fbf2401364841

Observation 81277e6e-bdb1-44e9-a6a3-cd7a0993c5e3 · outbound

This paper cites Efficient streaming language models with attention sinks.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Efficient streaming language models with attention sinks

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.839852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:8a983f5d0d3c7acad9bda66f7352374abe3f21e0fe701c1b07b53e988153c312

Observation e22f475f-a47b-4caa-b7fa-645bad8cc22d · outbound

This paper cites Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process

Reference 45

Resolution
verified exact
local_arxiv, observed 2026-07-09T02:55:53.514975Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:8f6212ec70d631d4ca5d4cbd69ae8c828c1065fdfc85e1db5ca8ac36c6d1809d

Observation 38e1eb26-8f65-4542-a5da-16adccc536ac · outbound

This paper cites Reddi, and Sanjiv Kumar.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Reddi, and Sanjiv Kumar

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.848655Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:14fe499c27b23499dfd2de804a26b59d5de096a32c090bf6fea0f2dca986a2c5

Observation 3ca05476-8c3f-469d-8cf2-615542bc6cc8 · outbound

This paper cites Found in the middle: How language models use long contexts better via plug-and-play positional encoding, 2024.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Found in the middle: How language models use long contexts better via plug-and-play positional encoding, 2024

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.779142Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:499929c2bdb70d83889c75b9ca5e93b5e7ba3fc9579d13d09dbe544ec86ae287

Observation 50d61d94-f5bd-4018-9844-a1beaa0b7eea · outbound

This paper cites Zhao, Eric Wallace, Shi Feng, Dan Klein, and Sameer Singh.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Zhao, Eric Wallace, Shi Feng, Dan Klein, and Sameer Singh

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.897922Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:71c54d74d3007698cab1761f8335e5acdc78134aefca5d5bfb34636b7b75ca65

Observation bc3321f1-1aeb-477d-885b-acf01a44c0e6 · outbound

This paper cites Xing, Haotong Zhang, Joseph E.

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization Xing, Haotong Zhang, Joseph E

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.836812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:f8f594589a4b6b4acabdd327e22048e9de076c6f5bc345a6813827c1557b9dfa

Observation c119a7cc-620f-4da8-a434-21d4cd5b6195 · outbound

This paper cites [43] show the multi-layer effects of masks and positional encodings [43].

How Data Shapes RoPE Frequency Usage: From Positional Scale Matching to Length Generalization [43] show the multi-layer effects of masks and positional encodings [43]

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-07-09T02:55:53.820066Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-07-09T02:52:28.852922Z digest=sha256:45998dae5c236eb11c070a7e3c6541a06d1a4a105c09aa3e14d8ce97559bfe32

Pith citing papers

No inbound Pith citation observations are available.