Paper Citation Record · LEDGER

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It

As of 8 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2506.23864.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.23864 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T21:45:09.858119Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

verified exact2
verified fuzzy1
unresolved21
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 04b768e8-97c6-47a4-9e6b-72623c83f357 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:11.616138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 6ddfcbc4-d589-44a4-a627-a6805ccc57bc · outbound

This paper cites LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.494636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d9dbd08-14db-4c44-ac8b-4a56e9f2442c · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.592435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 22ed2e5a-77d4-4f14-a3c5-255b268485e6 · outbound

This paper cites Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.680865Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4343a08f-fe5b-4c6f-80de-722db85388de · outbound

This paper cites Holliday, Matthew Mandelkern, and Cedegao E.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Holliday, Matthew Mandelkern, and Cedegao E

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.762323Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0dbf4ed-ec76-4b2b-a4a2-82463cc93e08 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:07.853315Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a9a6e182-35ca-4249-aa51-3bcf20cd5dab · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:11.448608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c4351088-cf4c-466f-b834-5eab14ae8bc6 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.047011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a20ce4a-cef7-4f14-91c9-c414363f814f · outbound

This paper cites Levenshtein.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Levenshtein

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T21:45:11.281585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation e2806cf4-e1a3-4291-8d88-34263ede61be · outbound

This paper cites Learn to Reason Efficiently with Adaptive Length-based Reward Shaping.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Learn to Reason Efficiently with Adaptive Length-based Reward Shaping

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.292468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cf2d6ce1-af97-498d-aed2-b364763e7776 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.397583Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02b12aa6-2d16-452a-b062-72d6f98f9aac · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:11.136027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 72af9341-205d-4149-8ae4-fc27e3ebd08d · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.643047Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41ab8d18-7e89-40bf-9857-b35e4732859e · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 14

Resolution: verified exact; doi, observed 2026-08-06T21:45:10.341273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 91356da8-2dc1-4b43-82c7-69dbc087a52e · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 15

Resolution: verified exact; doi, observed 2026-08-06T21:45:10.174421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 0cf6967e-2868-4373-8d53-a9039a7303a9 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:08.995084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6f1721d-41e5-4de6-80ca-63aabe11e91d · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:10.939571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation d936c27c-6299-4745-aa9f-c3424edae33c · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-06T21:45:10.788391Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 47c00e00-2ba2-4f4f-91f5-179082699545 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.333753Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d2aa662-8c54-4ab7-bc5d-a26c3be11446 · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.437143Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df0b3053-1854-4c72-bb4e-e21f272b49ec · outbound

This paper cites an unresolved cited work.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.540576Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6aae24ad-7f5b-461d-86c6-b3475dc7a39f · outbound

This paper cites Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.632588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 02bc54b7-3f06-43ff-98a4-002725d0b6c4 · outbound

This paper cites online" 'onlinestring :=.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It online" 'onlinestring :=

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.718730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20d58dfc-6ae5-4e26-97d6-113dbb567eb5 · outbound

This paper cites write newline.

Garbage In, Reasoning Out? Why Benchmark Scores are Unreliable and What to Do About It write newline

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T21:45:09.858119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.