Paper Citation Record · LEDGER

InfoSynth: Information-Guided Benchmark Synthesis for LLMs

As of 8 August 2026, this Paper Citation Record lists 43 of 43 outbound references and 1 inbound Pith citation observation for arXiv:2601.00575.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2601.00575 v2

Coverage vector

measured 43 of 43 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-03T13:06:59.375076Z

measured 44 of 44 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T20:02:33.346701Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-10T22:15:50.902427Z

Reference resolution

43 of 43 outbound references displayed

verified exact1
verified fuzzy0
unresolved42
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation f3de058c-7aba-4794-8363-d8684974b1da · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:55.851757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bffcf012-bfdc-4ad3-a0db-5799ec02c6ba · outbound

This paper cites Program Synthesis with Large Language Models.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Program Synthesis with Large Language Models

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:55.931537Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e3cd75c-b47b-44ea-9e37-106507f75ebe · outbound

This paper cites Evaluating Large Language Models Trained on Code.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Evaluating Large Language Models Trained on Code

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:55.990460Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c85c229-fcb5-4a33-9dae-16d0bacd200c · outbound

This paper cites Learning Code Preference via Synthetic Evolution.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Learning Code Preference via Synthetic Evolution

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.241435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d4be606b-721e-4d4b-89e0-b12cab9a134a · outbound

This paper cites Genetic Instruct: Scaling up Synthetic Generation of Coding Instructions for Large Language Models.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Genetic Instruct: Scaling up Synthetic Generation of Coding Instructions for Large Language Models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.330378Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d12fa573-64ec-49d5-b639-c804378e878d · outbound

This paper cites CrowdSelect: Synthetic Instruction Data Selection with Multi-LLM Wisdom.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs CrowdSelect: Synthetic Instruction Data Selection with Multi-LLM Wisdom

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.391359Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 05ed4e35-2f7e-45cf-887d-99c26bddc183 · outbound

This paper cites Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Unleashing LLM Reasoning Capability via Scalable Question Synthesis from Scratch

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.449752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf591bfb-47c0-48cf-9a55-9b0d8c4e6d32 · outbound

This paper cites MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.522253Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9ae1a502-7f26-4476-a943-dbeec43be201 · outbound

This paper cites Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Models.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.632597Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3029555b-e8df-42a5-819c-a8b989a4c571 · outbound

This paper cites Investigating data contamination in modern benchmarks for large language models.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Investigating data contamination in modern benchmarks for large language models

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.715562Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7af6975-7705-48c2-9735-dff15f3655f1 · outbound

This paper cites A careful examination of large language model performance on grade school arithmetic.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs A careful examination of large language model performance on grade school arithmetic

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.785264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c8b5ff6b-e1f5-4504-95b4-b062c23ff360 · outbound

This paper cites Smith, Daniel Khashabi, and Hannaneh Hajishirzi.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Smith, Daniel Khashabi, and Hannaneh Hajishirzi

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.887852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7ec2056-2643-4991-b361-8d3da8feb0b3 · outbound

This paper cites PromptCoT: Synthesizing Olympiad- level Problems for Mathematical Reasoning in Large Language Models.ArXiv preprint, abs/2503.02324, 2025.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs PromptCoT: Synthesizing Olympiad- level Problems for Mathematical Reasoning in Large Language Models.ArXiv preprint, abs/2503.02324, 2025

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.971044Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8c29a0e5-864a-4fcd-90c9-5ea59198309c · outbound

This paper cites Wizardlm: Empowering large pre-trained language models to follow complex instructions.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Wizardlm: Empowering large pre-trained language models to follow complex instructions

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.081439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8bbdfa41-e06b-4a2d-bfaf-9a5b9630502a · outbound

This paper cites KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Coding

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.148919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 92d7c7ee-9db1-488a-b51e-8352c5292a96 · outbound

This paper cites DSTC: Direct Preference Learning with Only Self-Generated Tests and Code to Improve Code LMs.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs DSTC: Direct Preference Learning with Only Self-Generated Tests and Code to Improve Code LMs

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.228768Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b94c0dae-105f-471e-bd15-ed0e24365f63 · outbound

This paper cites RLTF: Reinforcement Learning from Unit Test Feedback.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs RLTF: Reinforcement Learning from Unit Test Feedback

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.310399Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 43bd36ff-4467-4018-81aa-7d322da81368 · outbound

This paper cites Codet: Code generation with generated tests.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Codet: Code generation with generated tests

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.411327Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0fb976f-3e71-4e52-b8a6-b6a78b2ac132 · outbound

This paper cites ACECODER: Acing Coder RL via Automated Test-Case Synthesis.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs ACECODER: Acing Coder RL via Automated Test-Case Synthesis

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.644309Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c05cfc81-840e-41f6-86c8-b2843ddabd5c · outbound

This paper cites AutoBencher: Towards Declarative Benchmark Construction.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs AutoBencher: Towards Declarative Benchmark Construction

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.777782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 123ed1fc-0488-4c1a-8f4c-b83a1ad1cf3b · outbound

This paper cites Reliable and Efficient Amortized Model-based Evaluation.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Reliable and Efficient Amortized Model-based Evaluation

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.856178Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fdeccba1-bbef-4460-98ff-3f94968f426b · outbound

This paper cites Agentsynth: Scalable task generation for generalist computer-use agents.arXiv preprint arXiv:2506.14205, 2025.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Agentsynth: Scalable task generation for generalist computer-use agents.arXiv preprint arXiv:2506.14205, 2025

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.906527Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation abf59272-dfc7-4663-a980-298e06bce364 · outbound

This paper cites TaskE- val: Assessing Difficulty of Code Generation Tasks for Large Language Models.ArXiv preprint, abs/2407.21227, 2024.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs TaskE- val: Assessing Difficulty of Code Generation Tasks for Large Language Models.ArXiv preprint, abs/2407.21227, 2024

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.954155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 024a8bd0-43ef-4564-a37a-40ef30ca35f8 · outbound

This paper cites Proximal Policy Optimization Algorithms.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Proximal Policy Optimization Algorithms

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.994680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1383ffe7-6984-470b-9f3b-f3be67f45976 · outbound

This paper cites Auto-Encoding Variational Bayes.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Auto-Encoding Variational Bayes

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.157615Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d171bd11-90d0-4cc3-ae25-5628caeaa069 · outbound

This paper cites Kulkarni, and Sergio Verd ´u.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Kulkarni, and Sergio Verd ´u

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.234612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9b5f036f-6a77-43e8-b0b7-f0f04d8a24fe · outbound

This paper cites Mpnet: Masked and permuted pre-training for language understanding.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Mpnet: Masked and permuted pre-training for language understanding

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.342371Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 21e0e937-5a03-49d2-b033-bf43f092c417 · outbound

This paper cites UMAP: Uniform Manifold Approximation and Projection.J.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs UMAP: Uniform Manifold Approximation and Projection.J

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.516361Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a3cd2884-39e6-4a8c-83a7-56a79fb737b1 · outbound

This paper cites leetcode-problem-set.https://huggingface.co/datasets/kaysss/ leetcode-problem-set, 2025.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs leetcode-problem-set.https://huggingface.co/datasets/kaysss/ leetcode-problem-set, 2025

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.616219Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 724e547d-0f80-4af4-90ff-51fda4f5713b · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Measuring Coding Challenge Competence With APPS

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.708260Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 84ceb433-499b-4bdc-b138-dab9f9506927 · outbound

This paper cites Codeforces Problems Dataset.https://huggingface.co/datasets/open-r1/ codeforces, 2024.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Codeforces Problems Dataset.https://huggingface.co/datasets/open-r1/ codeforces, 2024

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.778454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a6f66b5-297e-45b4-bbfc-d13b631313ec · outbound

This paper cites Estimating mutual information.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Estimating mutual information

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.878286Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d5fba77-c506-498a-9dea-3eee727b60df · outbound

This paper cites Chi, Quoc V.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Chi, Quoc V

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.965242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9c4ed60e-8a87-4571-bc77-66482d40e6f7 · outbound

This paper cites GPT-4o System Card.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs GPT-4o System Card

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:59.062298Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9b42878a-468e-41b8-96ca-7a3cfc5e8e58 · outbound

This paper cites LeetCodeDataset: A Temporal Dataset for Robust Evaluation and Efficient Training of Code LLMs.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs LeetCodeDataset: A Temporal Dataset for Robust Evaluation and Efficient Training of Code LLMs

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:59.145164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35a58ca6-e98b-46ad-a93c-38a70007ad1b · outbound

This paper cites mutation.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs mutation

Reference 39

Resolution: verified exact; doi, observed 2026-08-03T13:08:44.174150Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 55ab3509-0acc-47ee-b460-0bac56f41aae · outbound

This paper cites an unresolved cited work.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Unresolved cited work

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:59.303512Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df3c06f3-6d0b-4b2f-86dc-e979b37ad0e4 · outbound

This paper cites "" Returns the second shortest string containing all vowels, sorted alphabetically.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs "" Returns the second shortest string containing all vowels, sorted alphabetically

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:59.375076Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e740ced-43f7-4aec-b577-2d1bbd375d31 · outbound

This paper cites URLhttps://doi.org/10.1109/TIT.2009.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs URLhttps://doi.org/10.1109/TIT.2009

Reference 2009

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:58.302413Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b4efbeb3-5fb2-41a3-8528-9c6219c171b7 · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Training Verifiers to Solve Math Word Problems

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:56.139632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 96ffab30-1cc8-4b8e-b853-43c6cee55eaf · outbound

This paper cites an unresolved cited work.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs Unresolved cited work

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.459481Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cc549862-298c-4629-99d0-afa80309e6df · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:55.835516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f9a1a96b-adc0-49d9-bd59-15713e5e601e · outbound

This paper cites URLhttps://openreview.net/forum?id=ymt4crbbXh.

InfoSynth: Information-Guided Benchmark Synthesis for LLMs URLhttps://openreview.net/forum?id=ymt4crbbXh

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-03T13:06:57.819399Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation b36d83cd-1e5c-4604-8f3d-091e50357979 · inbound

FLARE: Agentic Coverage-Guided Fuzzing for LLM-Based Multi-Agent Systems cites this paper.

FLARE: Agentic Coverage-Guided Fuzzing for LLM-Based Multi-Agent Systems InfoSynth: Information-Guided Benchmark Synthesis for LLMs

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-05-27T02:05:09.831408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.