Paper Citation Record · LEDGER

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments

As of 15 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 0 inbound Pith citation observations for arXiv:2606.17261.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.17261 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-27T02:24:45.803857Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

30 of 30 outbound references displayed

verified exact1
verified fuzzy0
unresolved29
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d0bfea6d-e9db-4bdc-abd8-487614488e9d · outbound

This paper cites Tracking down performance variation against source code evolution.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Tracking down performance variation against source code evolution

Reference 1

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e81b01b2-398b-4314-858d-53d529279c8e · outbound

This paper cites Writing fast code, 2015.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Writing fast code, 2015

Reference 2

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 624f5940-b997-47ee-9929-191bbf4f9e37 · outbound

This paper cites Identification of causal effects using instrumental variables.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Identification of causal effects using instrumental variables

Reference 3

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c2174a5e-5e29-4cde-b792-2a6ce3de56bd · outbound

This paper cites Virtual machine warmup blows hot and cold.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Virtual machine warmup blows hot and cold

Reference 4

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 963e8b53-b9aa-4323-ba4e-cb2efe5a3549 · outbound

This paper cites Conditional inference from confidence sets.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Conditional inference from confidence sets

Reference 5

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e783d504-aa5d-495f-9dac-104809c494fc · outbound

This paper cites Robust benchmarking in noisy environments.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Robust benchmarking in noisy environments

Reference 6

Resolution: verified exact; local_arxiv, observed 2026-07-03T18:48:49.810116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9242d6e0-0925-43ce-ba7f-8c61d75f8be8 · outbound

This paper cites Statistical performance comparisons of computers.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Statistical performance comparisons of computers

Reference 7

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c571f712-c5c8-47fb-9771-c1f3d02bbda4 · outbound

This paper cites Planning of experiments.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Planning of experiments

Reference 8

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cb64fced-1fe1-459e-ab53-b6ed3b08880f · outbound

This paper cites Stabilizer: S tatistically sound performance evaluation.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Stabilizer: S tatistically sound performance evaluation

Reference 9

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1936e07-291a-46dc-b025-7e3ae0944d90 · outbound

This paper cites Paired benchmarking: H ow to measure performance, 2023.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Paired benchmarking: H ow to measure performance, 2023

Reference 10

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 123d3f20-89f1-4ceb-8751-13501b39fc48 · outbound

This paper cites An introduction to probability theory and its applications.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments An introduction to probability theory and its applications

Reference 11

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 137a8687-59d7-4156-aeb2-7f13b8b2adbf · outbound

This paper cites Statistically rigorous J ava performance evaluation.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Statistically rigorous J ava performance evaluation

Reference 12

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 077fe367-469d-4f0c-9eab-d2ffb5931ad1 · outbound

This paper cites A microbenchmark case study and lessons learned.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments A microbenchmark case study and lessons learned

Reference 13

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 08e90b1a-1188-4cdf-ba6b-c04944d93440 · outbound

This paper cites Longest interval between zeros of the tied-down random walk, the B rownian bridge and related renewal processes.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Longest interval between zeros of the tied-down random walk, the B rownian bridge and related renewal processes

Reference 14

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e322e50-14ed-4549-b901-3a810830694b · outbound

This paper cites URL https://github.com/google/benchmark/.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments URL https://github.com/google/benchmark/

Reference 15

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 246419e4-8000-436c-971b-0cf11abc189d · outbound

This paper cites Frequentist post-data inference.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Frequentist post-data inference

Reference 16

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 181db4db-1bc2-4545-ac65-ccccbb72781f · outbound

This paper cites Continuous benchmarking: U sing system benchmarking in build pipelines.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Continuous benchmarking: U sing system benchmarking in build pipelines

Reference 17

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1012afe-f9cd-47d9-9e40-094e313826bd · outbound

This paper cites Benchmarking as empirical standard in software engineering research.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Benchmarking as empirical standard in software engineering research

Reference 18

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6b3e6ee5-a92e-4a95-99a0-0e77c916fd68 · outbound

This paper cites An alternative to the kolmogrov-smirnov two-sample test.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments An alternative to the kolmogrov-smirnov two-sample test

Reference 19

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cf199e3a-b1c6-40ad-9811-82b5f7c1703b · outbound

This paper cites A note on the higher moments of the random variable t associated with the number of returns of a simple random walk.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments A note on the higher moments of the random variable t associated with the number of returns of a simple random walk

Reference 20

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8be3add6-50a8-49a6-9122-6b9131eb6351 · outbound

This paper cites The structure of scientific revolutions, volume 962.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments The structure of scientific revolutions, volume 962

Reference 21

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0d5a7549-3197-40e6-a94d-65d6b01da174 · outbound

This paper cites War of the benchmark means: T ime for a truce.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments War of the benchmark means: T ime for a truce

Reference 22

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2c71889c-723b-4478-8770-0c0bb960ac9e · outbound

This paper cites Producing wrong data without doing anything obviously wrong! ACM Sigplan Notices, 44 0 (3): 0 265--276, 2009.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Producing wrong data without doing anything obviously wrong! ACM Sigplan Notices, 44 0 (3): 0 265--276, 2009

Reference 23

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ba9f87f7-bbf4-4e91-87c6-4bc4a3a8eb44 · outbound

This paper cites Theory of games and economic behavior.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Theory of games and economic behavior

Reference 24

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2bcbf99f-670e-4f06-910c-412acdfbcf86 · outbound

This paper cites Using benchmarking to advance research: A challenge to software engineering.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Using benchmarking to advance research: A challenge to software engineering

Reference 25

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f6adb089-2e64-4b80-b91d-1c13e1813347 · outbound

This paper cites SPEC CPU 2006 B enchmarks, 2006.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments SPEC CPU 2006 B enchmarks, 2006

Reference 26

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c703ba4-ac89-4393-9e84-6d8e2d35e996 · outbound

This paper cites Some pairwise independent sequences for which the central limit theorem fails.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Some pairwise independent sequences for which the central limit theorem fails

Reference 27

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24dfd5ee-0e50-4365-a187-17c759b95dae · outbound

This paper cites Should computer scientists experiment more? Computer, 31 0 (5): 0 32--40, 1998.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Should computer scientists experiment more? Computer, 31 0 (5): 0 32--40, 1998

Reference 28

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0f5ad4a6-88ae-4f3b-9a45-45f85847c7ae · outbound

This paper cites Dynamic frequency scaling, 2024.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Dynamic frequency scaling, 2024

Reference 29

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 11744f11-fa13-4526-bd43-ded9ea14eab6 · outbound

This paper cites Non-stationary A B tests.

The Right Call for Software Benchmarking: Consistent Decisions in Stateful Environments Non-stationary A B tests

Reference 30

Resolution: unresolved; no resolver link, observed 2026-06-27T02:24:45.803857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.