Paper Citation Record · LEDGER

Why Do Large Language Models (LLMs) Struggle to Count Letters?

As of 15 August 2026, this Paper Citation Record lists 26 of 26 outbound references and 15 inbound Pith citation observations for arXiv:2412.18626.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.18626 v1

Coverage vector

measured 26 of 26 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T11:28:33.548684Z

measured 41 of 41 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 15 of 15 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T04:43:17.680979Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-10T09:37:00.787799Z

Reference resolution

26 of 26 outbound references displayed

verified exact1
verified fuzzy1
unresolved24
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2aa14162-3ec4-432e-bc36-a3941308f14f · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.574903Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 103a6269-a8b1-404a-879a-9055507c8938 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.559203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation ec28809f-b4f2-4537-8d96-3037df0b48bc · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.542442Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9dd8b884-347b-422e-868a-977b453e173e · outbound

This paper cites The Llama 3 Herd of Models.

Why Do Large Language Models (LLMs) Struggle to Count Letters? The Llama 3 Herd of Models

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.069009Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 80e08efc-3137-4420-b6d2-11cafb5e1be2 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.113079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b54cbc6b-8627-49b5-b7d3-4c0af20996da · outbound

This paper cites Mistral 7B.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Mistral 7B

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.167490Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b617d12-3fec-4a58-8903-1af69fa2fbf2 · outbound

This paper cites Funes, The Memorious.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Funes, The Memorious

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T11:28:34.524857Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation f55cc44b-8906-4056-800a-f643f612f102 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.244315Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d84d395-5287-4841-b6c0-498ee98a5e3a · outbound

This paper cites Large Language Models: A Survey.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Large Language Models: A Survey

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.261769Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f9f97ca1-bfb4-414c-9115-79eb74abff9d · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.380155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c1fcc651-ec99-400d-99af-769937bfd727 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 11

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.269170Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 98b18803-5d67-49f7-a187-aa799b5e9e3a · outbound

This paper cites GPT-4 Technical Report.

Why Do Large Language Models (LLMs) Struggle to Count Letters? GPT-4 Technical Report

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.286761Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 042b7949-4d46-4301-8df5-4c459f8d358d · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.252149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 7fb9d65d-a529-4919-91fe-a706a1240b29 · outbound

This paper cites Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs).

Why Do Large Language Models (LLMs) Struggle to Count Letters? Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs)

Reference 14

Resolution: verified exact; local_arxiv, observed 2026-08-11T11:28:33.950243Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation da49c45e-5d1e-40e7-83ea-fa3d69badb36 · outbound

This paper cites Toward a Theory of Tokenization in LLMs.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Toward a Theory of Tokenization in LLMs

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.306478Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 005224bb-53d9-445c-bf64-3e89726ae549 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.232588Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 0741fa2d-52c3-43f1-ad02-adfb2d64a341 · outbound

This paper cites Large Language Models Lack Understanding of Character Composition of Words.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Large Language Models Lack Understanding of Character Composition of Words

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.377761Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6474fba-4ed4-4dfa-9e7c-916f7fbbe018 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.212630Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation fed0774b-3889-486d-9585-a2fede557fb5 · outbound

This paper cites Attention Is All You Need.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Attention Is All You Need

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.490669Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 48eaf278-c5fe-45a4-9090-4d2e9f3c8c39 · outbound

This paper cites MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark.

Why Do Large Language Models (LLMs) Struggle to Count Letters? MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.513609Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6685f22-85f9-42e0-b39f-b6c827190be5 · outbound

This paper cites LLM The Genius Paradox: A Linguistic and Math Expert's Struggle with Simple Word-based Counting Problems.

Why Do Large Language Models (LLMs) Struggle to Count Letters? LLM The Genius Paradox: A Linguistic and Math Expert's Struggle with Simple Word-based Counting Problems

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.522746Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 976db0ec-b8a4-4471-a799-8a33997d8f53 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.530174Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f379a5fa-1c25-4908-8f5c-84e4e53df785 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.536071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 397c6201-55d8-4480-b959-c49d1e127cad · outbound

This paper cites How well do Large Language Models perform in Arithmetic tasks?.

Why Do Large Language Models (LLMs) Struggle to Count Letters? How well do Large Language Models perform in Arithmetic tasks?

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.542847Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a10021e-4c72-470c-914b-926f1a5b7ab8 · outbound

This paper cites an unresolved cited work.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-08-11T11:28:34.149365Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 822ff838-395b-4925-bb9f-e4deecdc40b2 · outbound

This paper cites Measuring Mathematical Problem Solving With the MATH Dataset.

Why Do Large Language Models (LLMs) Struggle to Count Letters? Measuring Mathematical Problem Solving With the MATH Dataset

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-11T11:28:33.252881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation c4413bd7-67ff-41f4-a961-a0a1b3289f92 · inbound

VerIF: Verification Engineering for Reinforcement Learning in Instruction Following cites this paper.

VerIF: Verification Engineering for Reinforcement Learning in Instruction Following Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T04:43:17.680979Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8253a5a2-d16a-417e-9068-178de9b74344 · inbound

Spelling-out is not Straightforward: LLMs' Capability of Tokenization from Token to Characters cites this paper.

Spelling-out is not Straightforward: LLMs' Capability of Tokenization from Token to Characters Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-07T04:26:31.714015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation de151689-db27-493d-9e9d-9f0de7b067cb · inbound

TASE: Token Awareness and Structured Evaluation for Multilingual Language Models cites this paper.

TASE: Token Awareness and Structured Evaluation for Multilingual Language Models Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-05T23:21:22.132885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9538caa5-b845-48dd-aae3-60c2d4c2d5a2 · inbound

IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation cites this paper.

IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 1

Resolution: metadata mismatch; arxiv_id, observed 2026-05-18T01:30:35.865984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 51beb92f-9082-4200-bdd9-6df8860e9694 · inbound

Understanding Counting Mechanisms in Large Language and Vision-Language Models cites this paper.

Understanding Counting Mechanisms in Large Language and Vision-Language Models Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 8

Resolution: verified exact; arxiv_id, observed 2026-05-17T20:10:10.907673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation b72a604f-f262-4c02-8da8-d83c08a253a8 · inbound

A Benchmark for Omni-Modal Reasoning in Long Videos cites this paper.

A Benchmark for Omni-Modal Reasoning in Long Videos Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-03T15:26:13.454457Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ccb224bd-6820-4335-a0b7-bca1a7f03d8f · inbound

Strategies for Span Labeling with Large Language Models cites this paper.

Strategies for Span Labeling with Large Language Models Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-03T08:28:02.255694Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c9955bcd-ce53-4e8f-9695-799da55a0125 · inbound

Language models fail at extended rule following cites this paper.

Language models fail at extended rule following Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 49

Resolution: verified exact; arxiv_id, observed 2026-05-21T00:09:16.898573Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 35003780-8e32-468c-ad72-dbedcac2698d · inbound

The Position Curse: LLMs Struggle to Locate the Last Few Items in a List cites this paper.

The Position Curse: LLMs Struggle to Locate the Last Few Items in a List Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-05-11T03:05:55.647711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d03ae7aa-2686-4e1e-8b17-74bb84e165ad · inbound

The Open-Box Fallacy: Why AI Deployment Needs a Calibrated Verification Regime cites this paper.

The Open-Box Fallacy: Why AI Deployment Needs a Calibrated Verification Regime Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 15

Resolution: verified exact; arxiv_id, observed 2026-05-12T07:11:26.515917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9f7ff329-5c1f-408a-b135-24720e3d9321 · inbound

Artificial Effort cites this paper.

Artificial Effort Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 16

Resolution: unresolved; no resolver link, observed 2026-07-12T19:34:03.845958Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64b444a2-78c8-47e9-8e49-a42b30bd0d4c · inbound

Empirical Evaluation of Large Language Models for Migration of Code Fragments to Post-Quantum Cryptography cites this paper.

Empirical Evaluation of Large Language Models for Migration of Code Fragments to Post-Quantum Cryptography Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-07-02T17:47:17.839190Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 04096664-3215-41c4-be42-7a4028081a90 · inbound

Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Models cites this paper.

Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Models Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 15

Resolution: verified exact; local_arxiv, observed 2026-07-10T09:37:00.788988Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4137c117-d0a9-4136-a1ef-1950f75099bf · inbound

AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language cites this paper.

AoA: Theorem Proving Agent over Abstract Syntax Tree of Redesigned Language Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-01T21:39:58.163407Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 892982bd-225e-41ad-8f3b-44a25c2f65a5 · inbound

Cognitive Convergence: Deep Similarities Between Large Language Models and Human Cognition cites this paper.

Cognitive Convergence: Deep Similarities Between Large Language Models and Human Cognition Why Do Large Language Models (LLMs) Struggle to Count Letters?

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-01T00:37:06.522815Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.