Paper Citation Record · LEDGER

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

As of 19 August 2026, this Paper Citation Record lists 33 of 33 outbound references and 12 inbound Pith citation observations for arXiv:2505.03171.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.03171 v1

Coverage vector

measured 33 of 33 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T00:04:38.456180Z

measured 45 of 45 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 12 of 12 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-14T04:18:57.397021Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-10T18:17:33.661610Z

Reference resolution

33 of 33 outbound references displayed

verified exact1
verified fuzzy8
unresolved24
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 271822d3-054f-45d0-b4e2-499584185f04 · outbound

This paper cites Claude 3.7 sonnet, 2025.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Claude 3.7 sonnet, 2025

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:39.155918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e36eddec-9d3c-4c99-a0a1-a35ae194a975 · outbound

This paper cites ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematics.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematics

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.304499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e87f5c6d-e14a-4a48-ac02-1d8295c98467 · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:39.140843Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 5f571164-bf15-4283-90ef-c718c4c2d972 · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:39.126277Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 38e7c6d4-4175-4071-89b1-b8a822688dbb · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:39.111430Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation bf58b874-5a58-40f9-be13-0863eb03d1da · outbound

This paper cites Chou, X.-S.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Chou, X.-S

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:39.095644Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation e10fc8cc-e407-424f-8124-b1a8c030f144 · outbound

This paper cites de Moura, S.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics de Moura, S

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:39.079183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 34828bb5-7f77-4451-8c4e-a76f11f231ef · outbound

This paper cites Dong and T.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Dong and T

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:39.063348Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1eb05b40-8015-44be-a945-3f934e1fea40 · outbound

This paper cites Gemini 2.5: Our most intelligent ai model, 2025.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Gemini 2.5: Our most intelligent ai model, 2025

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:39.047931Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 273ac6bc-9ae9-4cec-8e31-83d8d3a181ae · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.342897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d44e4573-b102-44b8-b335-6a6bab842091 · outbound

This paper cites OpenAI o1 System Card.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics OpenAI o1 System Card

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.347962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0be5b01d-6e81-4fb6-8e98-d384e2bc29f9 · outbound

This paper cites Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofs

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.352880Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23b6e7a1-b02d-4512-9ce0-2d2d77826670 · outbound

This paper cites Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Proving.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Proving

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.357808Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 33da42c2-99b2-4f58-92de-8c31a49504e6 · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:39.031934Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation cf369646-4a8e-439b-a112-d5eb45a337e5 · outbound

This paper cites mathlib Community.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics mathlib Community

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.366963Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 796942e2-beee-4e06-938e-e8ab2921a59e · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:39.016230Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation fa95f311-9cac-435a-8adb-6dc0b9470d52 · outbound

This paper cites Openai o3-mini, 2025.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Openai o3-mini, 2025

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.377268Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10f860fd-a62e-4db2-a761-3e114f5e85a7 · outbound

This paper cites Generative Language Modeling for Automated Theorem Proving.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Generative Language Modeling for Automated Theorem Proving

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.382016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7abc47ef-ac8a-49a3-bf9c-737cd25084ed · outbound

This paper cites A I M O P rize --- aimoprize.com.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics A I M O P rize --- aimoprize.com

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:38.990862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation d49227e7-a579-4d05-b219-e13e64bdfdf7 · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:38.975932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 2ce0e71f-0f97-4312-831c-5c3ff5b79273 · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:38.960185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation a3367479-a069-42f7-b8d6-a67f3e4772fb · outbound

This paper cites The Coq Proof Assistant , Sept.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics The Coq Proof Assistant , Sept

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:38.942752Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 5ad56077-1b7b-4cfc-b005-e1e453a7c7ac · outbound

This paper cites PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competition.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics PutnamBench: Evaluating Neural Theorem-Provers on the Putnam Mathematical Competition

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.404967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7246e3c0-dcd5-436f-ae25-9b6a87e60d4a · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:38.927133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 4543389d-6284-4d0c-af4a-ae42adaf444a · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:38.911865Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 6631b2b5-a931-4f4f-990e-ce329e9b6dc1 · outbound

This paper cites Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Kimina-Prover Preview: Towards Large Formal Reasoning Models with Reinforcement Learning

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.418720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8fc8521d-0820-4770-989d-7bc862e0d60b · outbound

This paper cites Wenzel, L.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Wenzel, L

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T00:04:38.895485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation d823ffda-1738-442e-a47d-ede3af7289d8 · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 28

Resolution: unresolved; raw_fallback, observed 2026-08-16T00:04:38.879361Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 284f4414-06e2-4d28-8895-f4b2f4677108 · outbound

This paper cites DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.434922Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9f1a46e6-a02e-4ff3-a25e-4f937c99b49c · outbound

This paper cites an unresolved cited work.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.439891Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 191eccc6-f994-406f-953c-c4214ba4e372 · outbound

This paper cites A Combinatorial Identities Benchmark for Theorem Proving via Automated Theorem Generation.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics A Combinatorial Identities Benchmark for Theorem Proving via Automated Theorem Generation

Reference 31

Resolution: verified exact; local_arxiv, observed 2026-08-16T00:04:38.537787Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 1d08fa3b-94ae-490f-b486-935800308495 · outbound

This paper cites Leanabell-Prover: Posttraining Scaling in Formal Reasoning.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics Leanabell-Prover: Posttraining Scaling in Formal Reasoning

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.449760Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5a883dde-249b-4b4c-b293-4a07491a0194 · outbound

This paper cites MiniF2F: a cross-system benchmark for formal Olympiad-level mathematics.

CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics MiniF2F: a cross-system benchmark for formal Olympiad-level mathematics

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-16T00:04:38.456180Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 12d6cf0d-b1a6-4584-8b73-eec6eaf0fd33 · inbound

Formally Solving Answer-Construction Problems in Lean cites this paper.

Formally Solving Answer-Construction Problems in Lean CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T14:34:08.568419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation afa26eea-fd01-4f0f-b282-3c0315185717 · inbound

Using Reasoning Models to Generate Search Heuristics that Solve Open Instances of Combinatorial Design Problems cites this paper.

Using Reasoning Models to Generate Search Heuristics that Solve Open Instances of Combinatorial Design Problems CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-07T12:45:45.804899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7b6d46b7-1d1b-4ec0-a8ca-b228f0b511fa · inbound

Seed-Prover: Deep and Broad Reasoning for Automated Theorem Proving cites this paper.

Seed-Prover: Deep and Broad Reasoning for Automated Theorem Proving CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T10:30:44.632329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 411ff25b-e1c7-4732-bc91-1fa4d83bc43f · inbound

PuzzleClone: A DSL-Powered Framework for Synthesizing Verifiable Data cites this paper.

PuzzleClone: A DSL-Powered Framework for Synthesizing Verifiable Data CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-05T18:08:41.447037Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ea9c2fc6-5462-481f-9c62-f7f119be5068 · inbound

CAM-Bench: A Benchmark for Computational and Applied Mathematics in Lean cites this paper.

CAM-Bench: A Benchmark for Computational and Applied Mathematics in Lean CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 22

Resolution: verified exact; arxiv_id, observed 2026-05-20T13:38:19.375605Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 8ad20165-ffd4-4808-b141-ac450dcfb472 · inbound

GTBench: A Curriculum-Grounded Benchmark for Evaluating LLMs as Mathematical Research Assistants in Graph Theory cites this paper.

GTBench: A Curriculum-Grounded Benchmark for Evaluating LLMs as Mathematical Research Assistants in Graph Theory CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 22

Resolution: verified exact; arxiv_id, observed 2026-07-02T03:06:30.307295Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 8adee818-56e3-4c85-b038-e6a0001730c9 · inbound

TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics cites this paper.

TheoremBench: Evaluating LLMs on Theorem Proving in Formal Mathematics CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-07-03T01:47:31.569259Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 359d3628-9664-4e30-96f0-1ea0999c09ff · inbound

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving cites this paper.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-06-30T07:04:21.947161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation 37f7c2a0-21c8-4a60-967c-08b179a944c0 · inbound

FormalRx: Rectify and eXamine Semantic Failures in Autoformalization cites this paper.

FormalRx: Rectify and eXamine Semantic Failures in Autoformalization CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 111

Resolution: unresolved; no resolver link, observed 2026-07-11T15:42:50.296348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 79717f3b-2b55-47a3-8743-0a1cc9b819e3 · inbound

From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier cites this paper.

From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 150

Resolution: verified exact; local_arxiv, observed 2026-07-10T18:17:33.662864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

Observation aeafd0f9-a93b-410d-a445-b0bb8f5d0e21 · inbound

TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Ability cites this paper.

TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Ability CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-11T15:30:26.803162Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 45e50f55-3e41-4643-a318-260d8c62b23b · inbound

TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Ability cites this paper.

TCS-BENCH: Benchmarking State-of-the-Art Generative AI Theoretical Computer Science Research Ability CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-14T04:18:57.397021Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.