Pith. sign in

Paper Citation Record · LEDGER

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps

As of 8 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 1 inbound Pith citation observation for arXiv:2607.10562.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.10562 v1

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-14T10:48:28.333572Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-14T10:48:28.333572Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

16 of 16 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved15
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2b291608-97f9-4a61-a539-98d65c08210a · outbound

This paper cites CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps

Reference 1

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:15e77a77d43c350c95636cdd712bf7a8fcea41ca61b363dbdb0a57df6b194a42

Observation 099935cf-042e-44d1-bf52-ee2d8655de26 · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:19fa60b1eb3664e66a05656352ad0d95700d76f2cd854af65584ff7e4891911b

Observation 6d146c7c-ccd4-423b-9d09-4267a48afbc2 · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:3615c72e2ecbb684d0a0d7f8923d55e4fe9bcc360ceb4c088dbeb35fe54e2be3

Observation ad3248cd-0ac9-47cc-bb14-1074880e5006 · outbound

This paper cites Ultimately, CRiT-QA serves as a rigorous diag- nostic tool for evaluating genuine multi-hop reason- ing in LLMs.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Ultimately, CRiT-QA serves as a rigorous diag- nostic tool for evaluating genuine multi-hop reason- ing in LLMs

Reference 4

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:e7051d743c8d51ce192a948c656421a65dee92fe035c2580d788cb8719ace03f

Observation 679f1fb0-05f1-4d64-847f-7d4e63540132 · outbound

This paper cites HotpotQA (Yang et al., 2018) requires multi-hop reasoning across linked Wikipedia articles, with annotated support- ing facts that enable explainable evaluation.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps HotpotQA (Yang et al., 2018) requires multi-hop reasoning across linked Wikipedia articles, with annotated support- ing facts that enable explainable evaluation

Reference 5

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:403e06b515a646988f6d2d500e4dc75b5a4245970e0ff848fdca47456092b98e

Observation 0a3a9f7a-f4de-4387-8dbe-0e9cf30a1841 · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:4b2c478022f5e0e223e46a9ae1f9bca98786d282f06303181f959b46721ab926

Observation 38150952-bf9a-4165-ae90-f399654133fb · outbound

This paper cites Reasoning under Counterfactual Knowledge.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Reasoning under Counterfactual Knowledge

Reference 7

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:77ef78a45465233bdbacdbb0b6be431e1ec4ba38b9b8bb1c3a10585c8f4112dd

Observation 9d5832f0-4cd7-478d-82eb-f52be691b159 · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:5631c3a0ca2bd07d1479402cc11bfd7d6250fde1397563b2935d87bc704b49bd

Observation 037f73c9-3d97-403d-aa8a-56804688f62f · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 9

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:15b6ea6efb60ce0e36f63b7194945ee655164c2bceb0607e6e0c337c03bd50fc

Observation c58fd255-6430-48fd-8add-530b387dc93c · outbound

This paper cites Experimental Setup We evaluate LLMs on our constructed CRiT- QA dataset using a diverse set of models.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Experimental Setup We evaluate LLMs on our constructed CRiT- QA dataset using a diverse set of models

Reference 10

Resolution
malformed identifier
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:9e32f031268a8478e838703699f05b571cfe98d1eb5f1ed56992ebfe1dbdae3c

Observation ca23eb4e-921a-42f1-8d23-95f5cfae4d4a · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:05b3bbad78d3eb6a7e7b441bf803c6b5172da03665b2255f0776a2479bcd0f32

Observation d71bb149-57ae-4aec-8ad7-820bd3281f58 · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:07069f74cd4e009c9627d18d261beed68f977f28fa731301776521debcc3477a

Observation ebc176a1-22ef-4613-a374-17f85c022410 · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 13

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:f514db523a2506240ac22ceaaaa3f8e7667e0338c6b4b79cbcc62dec6f2d5924

Observation c09a8b84-6626-4fd3-ae4d-22eebda5e6b6 · outbound

This paper cites an unresolved cited work.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Unresolved cited work

Reference 14

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:755da8996e8a11c6b9c9b5b711b239f5b059e3460adb09889244a4b3a533bba8

Observation bd1a4a03-7ae7-4235-82a6-b07850e8df8b · outbound

This paper cites Parameters vs. Context: Fine-Grained Control of Knowledge Reliance in Language Models.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps Parameters vs. Context: Fine-Grained Control of Knowledge Reliance in Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:b41546a48622cff5de41fe46314cbda84cf249d99a85d5d9ebaebd6623dd081e

Observation e7459030-7f2f-4155-941a-08096627159b · outbound

This paper cites MoreHopQA: More Than Multi-hop Reasoning.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps MoreHopQA: More Than Multi-hop Reasoning

Reference 16

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:ef5d026d74ede8675de2956b06a64141168ef06a61c1cde8e6024c99437d927d

Pith citing papers

Observation 2b291608-97f9-4a61-a539-98d65c08210a · inbound

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps cites this paper.

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps

Reference 1

Resolution
unresolved
no resolver link, observed 2026-07-14T10:48:28.333572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T10:48:28.333572Z digest=sha256:15e77a77d43c350c95636cdd712bf7a8fcea41ca61b363dbdb0a57df6b194a42