Paper Citation Record · LEDGER

Benchmarking in Optimization: Best Practice and Open Issues

As of 18 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 20 inbound Pith citation observations for arXiv:2007.03488.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2007.03488 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 20 of 20 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T05:38:52.766499Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

81
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 8f5b9b41-f818-4aec-895d-be45842aefef · inbound

How NOT to Fool the Masses When Giving Performance Results for Quantum Computers cites this paper.

How NOT to Fool the Masses When Giving Performance Results for Quantum Computers Benchmarking in Optimization: Best Practice and Open Issues

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-12T21:21:28.961525Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c9de061-6e3a-4c1b-be3f-9899495688ea · inbound

BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices cites this paper.

BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices Benchmarking in Optimization: Best Practice and Open Issues

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-12T17:01:31.274747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a11a392-f6f5-4e89-8127-98f453d3d61e · inbound

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation cites this paper.

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation Benchmarking in Optimization: Best Practice and Open Issues

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-08T15:06:54.755116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6bab795b-5d7a-4aac-b1bf-15429b04ebec · inbound

Evolving Hard Maximum Cut Instances for Quantum Approximate Optimization Algorithms cites this paper.

Evolving Hard Maximum Cut Instances for Quantum Approximate Optimization Algorithms Benchmarking in Optimization: Best Practice and Open Issues

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-09T23:48:17.782842Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3aa0701f-3724-4fd4-b93e-0f8dd62e6184 · inbound

BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics cites this paper.

BLADE: Benchmark suite for LLM-driven Automated Design and Evolution of iterative optimisation heuristics Benchmarking in Optimization: Best Practice and Open Issues

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-16T05:38:52.766499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 839d5e7a-2110-4da7-9f92-836957bfcb98 · inbound

The Leaderboard Illusion cites this paper.

The Leaderboard Illusion Benchmarking in Optimization: Best Practice and Open Issues

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-16T05:22:55.390379Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd4417bd-cfac-49e1-8adb-b89e99dc0b0a · inbound

Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows cites this paper.

Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows Benchmarking in Optimization: Best Practice and Open Issues

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-15T23:34:30.061937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6218c146-8d0c-4b12-88bb-702c6044382d · inbound

A Standardized Benchmark Set of Clustering Problem Instances for Comparing Black-Box Optimizers cites this paper.

A Standardized Benchmark Set of Clustering Problem Instances for Comparing Black-Box Optimizers Benchmarking in Optimization: Best Practice and Open Issues

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-15T21:41:14.848157Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9832cd89-e843-417e-b7c3-0a729dc1be8d · inbound

Evolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications cites this paper.

Evolutionary Computation and Large Language Models: A Survey of Methods, Synergies, and Applications Benchmarking in Optimization: Best Practice and Open Issues

Reference 102

Resolution: unresolved; no resolver link, observed 2026-08-07T15:14:14.368704Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 83ff0f77-70fa-4924-a1b6-106c7146c4a6 · inbound

Adaptive Estimation of the Number of Algorithm Runs in Stochastic Optimization cites this paper.

Adaptive Estimation of the Number of Algorithm Runs in Stochastic Optimization Benchmarking in Optimization: Best Practice and Open Issues

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T20:52:33.652339Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e81509b0-9a7a-47f2-8373-064ac0d04679 · inbound

Time-Fair Benchmarking for Metaheuristics: A Restart-Fair Protocol for Fixed-Time Comparisons cites this paper.

Time-Fair Benchmarking for Metaheuristics: A Restart-Fair Protocol for Fixed-Time Comparisons Benchmarking in Optimization: Best Practice and Open Issues

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-04T19:55:37.749997Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dfadd84a-1e3c-4320-b1f5-c1fef273b345 · inbound

Large-scale benchmarking of multi-objective soft-computing metaheuristics for redundancy allocation in repairable k-out-of-n systems cites this paper.

Large-scale benchmarking of multi-objective soft-computing metaheuristics for redundancy allocation in repairable k-out-of-n systems Benchmarking in Optimization: Best Practice and Open Issues

Reference 2020

Resolution: unresolved; no resolver link, observed 2026-08-03T15:03:59.523369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4da50941-ef9c-43a8-a0b1-eed7e70ddffe · inbound

From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors cites this paper.

From Heuristic Selection to Automated Algorithm Design: LLMs Benefit from Strong Priors Benchmarking in Optimization: Best Practice and Open Issues

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-02T19:18:47.283722Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3ae70280-6bc4-40dd-96d0-e435ba5c8dc1 · inbound

Block-Bench: A Framework for Controllable and Transparent Discrete Optimization Benchmarking cites this paper.

Block-Bench: A Framework for Controllable and Transparent Discrete Optimization Benchmarking Benchmarking in Optimization: Best Practice and Open Issues

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-05-11T05:45:57.835456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 7b169012-40be-46a4-896b-7431fd2f924c · inbound

SPEC CPU: The Next Generation cites this paper.

SPEC CPU: The Next Generation Benchmarking in Optimization: Best Practice and Open Issues

Reference 68

Resolution: verified exact; arxiv_id, observed 2026-05-11T11:06:01.910719Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation f850d22d-e0bd-493b-8caa-5abe68a7a476 · inbound

Learning to Assess the Reliability of Number-of-Runs Estimation in Stochastic Optimization cites this paper.

Learning to Assess the Reliability of Number-of-Runs Estimation in Stochastic Optimization Benchmarking in Optimization: Best Practice and Open Issues

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-06-29T14:13:30.378869Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation fffbc3d7-f515-493e-8edb-3d6d83697c2e · inbound

Improving Evaluation of Recombination-based Cartesian Genetic Programming cites this paper.

Improving Evaluation of Recombination-based Cartesian Genetic Programming Benchmarking in Optimization: Best Practice and Open Issues

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-06-29T09:33:17.374478Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 85ff7dc3-577d-4883-b435-ba4af4b92173 · inbound

Asymmetry PRISM: A CPU/GPU Portfolio Optimization Engine for Deadline-Bounded Institutional Rebalancing cites this paper.

Asymmetry PRISM: A CPU/GPU Portfolio Optimization Engine for Deadline-Bounded Institutional Rebalancing Benchmarking in Optimization: Best Practice and Open Issues

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-07-04T12:49:52.929709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation bb4464d7-c67d-4fac-abc2-313cda0ddd26 · inbound

Standardizing case study descriptions for multi-energy systems and networks modeling cites this paper.

Standardizing case study descriptions for multi-energy systems and networks modeling Benchmarking in Optimization: Best Practice and Open Issues

Reference 24

Resolution: verified exact; arxiv_id, observed 2026-07-01T04:35:20.343205Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 88aaaa8c-73de-4d25-ac65-01db0df989c7 · inbound

Sensitivity of hMPA to Controlled CEC 2017 Transformations cites this paper.

Sensitivity of hMPA to Controlled CEC 2017 Transformations Benchmarking in Optimization: Best Practice and Open Issues

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T15:36:19.814764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.