Pith. sign in

Paper Citation Record · LEDGER

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving

As of 22 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 1 inbound Pith citation observation for arXiv:2606.29493.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.29493 v1

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-30T06:56:32.253843Z

measured 22 of 22 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-31T17:33:57.657900Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

21 of 21 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved19
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 359d3628-9664-4e30-96f0-1ea0999c09ff · outbound

This paper cites CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving CombiBench: Benchmarking LLM Capability for Combinatorial Mathematics

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-06-30T07:04:21.947161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:573eea113f7da0d118971e7b7289314a988e28c42419af4ff6247cfad81e5157

Observation d80b969e-29a2-42e8-bf2b-48d4de7043eb · outbound

This paper cites 11 Faults in Our Formal Benchmarking A.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving 11 Faults in Our Formal Benchmarking A

Reference 2

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:5b50ea555a1630ba64e0a6c376e11bf9f9e2942a132a1734f4bd72b403596a53

Observation c4263bc3-8ca2-4cd6-b7c1-302063667b30 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:5a5d2301dc9e8f853ab05b159b512231ea832d90c7f1628f5e2f37a3319d4033

Observation 9d9de0ea-38e1-463c-9826-83283ffe9c31 · outbound

This paper cites They also release FormalMath Lite, a carefully selected subset of 425 problems (comprising 359 high school-level and 66 undergraduate- level problems).

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving They also release FormalMath Lite, a carefully selected subset of 425 problems (comprising 359 high school-level and 66 undergraduate- level problems)

Reference 4

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:616228f350a99f253edd19aaa2d1134d3aeb7c3337c87361f22a7a06a8ca342f

Observation e614c2c3-3048-4be7-8473-0bc2cc515186 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:25f2f5d5ac3952c6105430e72ade9b5ae39ae3bb3a2cfdc9a861c5f4a06833ec

Observation d7e727e3-7107-4878-b2de-8ca9ce1218a6 · outbound

This paper cites complete.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving complete

Reference 6

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:1d5d7417c1eddc60341afbf6c1f57286570d1433950a32291b11cb9bff4656e3

Observation 8caf23e3-40fd-4564-94b8-ce970bbd96d5 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 7

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:9a8b7bbf83779e1ad523bf43aa9b96a14715830f95aeca31b9f5a4532325e808

Observation 184cc103-a8fe-47bb-a590-b78d3f4d94a1 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:940c49a3a1db631d3521f498d6d7fee8d9feadc10da46240c4cc2fd740655ffa

Observation bf19361e-a381-4bf3-8247-2e2b5d00f51d · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 9

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:1c72ab31e93d970f2239543af5c3873ddd20dcaef731ab40595e16f10114cb25

Observation bc49de84-d541-4b21-85c5-97351097fb21 · outbound

This paper cites This discharges approximately 60% of valid guards automatically.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving This discharges approximately 60% of valid guards automatically

Reference 10

Resolution
malformed identifier
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:a8c06b376ac79c0d322abcaf7797ae93d8fda5e77d6badc8bd230c21a1ac3f4b

Observation f30979a5-3b1e-4750-aa55-23ed636fc8a8 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:f473e9e7485c61f5439df73b68e21bd7cd3b6ddbd47bac6662564c451d116d1d

Observation b76f3c93-b1ea-464d-80b2-2cf2e251592d · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:b6fce344feac212d6db738de41eb71d6c2e516c7e1c20efa6b8f84e460f0c665

Observation 087fa128-310a-4029-8a5f-dd27352dda9d · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:db6767aae99ca19032f6ba1c2ff76e0291c37041d2bdd97d11d9442423f727a1

Observation 88932f99-f1e6-44eb-b0c4-7095cb372668 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 14

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:65042a2b079a8e21d601a4618fcba0c64dafd39674fcb5e9ef3ac4cdce258a44

Observation 598687f0-411a-4b42-b5e1-cde3a3e9f931 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 15

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:6e748eda93c02afdaa7db66b81d66f62bc8fd3edb5acfd29d18cdb4229d1aa70

Observation c4cb1ad3-5c50-4b28-bbd2-4ba688d2fdd2 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 16

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:41feb01504a782e10abb460457cc20de1bc6f40a613a2379c25ac781cae11688

Observation 8d50a34e-5ea6-4eca-bae3-405575fc928d · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 17

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:c8f37e5b7ba67a2d369c307dfaf48a1754097e5d6c0b41f01cbdee9bfc5306de

Observation 77bc1b99-d7e0-499a-86a7-23dd27ada549 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:35fd0e6ce4d679029d73ebc4bc000b0fd43e8893afd47ffc81c565a009fe0aaa

Observation e4346a7b-84dc-4067-b30e-e5f9ffed86f8 · outbound

This paper cites an unresolved cited work.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving Unresolved cited work

Reference 19

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:20d9165345187e184937390868658dc4816ef255064e0b39dad05acf7f4eeb71

Observation 2f21dfc3-4375-482f-9388-9b91277d46a5 · outbound

This paper cites YES". 6.DetailTagsmust be chosen ONLY from the allowed list. Output format (JSON): Verdict:.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving YES". 6.DetailTagsmust be chosen ONLY from the allowed list. Output format (JSON): Verdict:

Reference 20

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:6facee635fd03e1110267726dceb8d7199eb251c8dd2ba9d296ece621cb3bb3a

Observation 9481825c-dc7f-460d-bab1-6260a75ec328 · outbound

This paper cites prime p dividing its order.

Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving prime p dividing its order

Reference 21

Resolution
unresolved
no resolver link, observed 2026-06-30T06:56:32.253843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-06-30T06:56:32.253843Z digest=sha256:b789f903c20f3372e0c7948c806f299bbc63c93895024431a439e91ea8dafa54

Pith citing papers

Observation 7b639108-f0df-4267-b769-2dab016c3af2 · inbound

BlueprintRepair: Typed Local Edits for Failed Lean Proof Blueprints cites this paper.

BlueprintRepair: Typed Local Edits for Failed Lean Proof Blueprints Faults in Our Formal Benchmarking: Dataset Defects and Evaluation Failures in Lean Theorem Proving

Reference 2

Resolution
unresolved
no resolver link, observed 2026-07-31T17:33:57.657900Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-07-31T17:33:57.657900Z digest=sha256:51beff6476025dbb9a5705f0173c35c48c6c7214ed16be357624844d905180d9