Pith. sign in

Paper Citation Record · LEDGER

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models

As of 8 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2505.15094.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15094 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:28:54.724615Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

  • verified exact0
  • verified fuzzy10
  • unresolved9
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation f8798d0d-70ce-4337-a32a-e225fd48601e · outbound

This paper cites Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.318916Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:52.588990Z digest=sha256:db62439dd933e63bae9c7c7b5b21ad6254617ec793135df5a54593c3422e0381

Observation f160ef1d-ea84-411d-b4b2-465306eb50db · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:59.055039Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:52.741538Z digest=sha256:a3c7e28153feff95d6be245bfad018bba47b4d82f7130838e20faf9c78c5eb29

Observation 02420a4d-3df6-4e17-a903-71ed5ef4739b · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:58.697425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:52.915943Z digest=sha256:c4b241efe1a379d1fcee2ce687ac430be1ba07aa6ed8e844ccb2896b1d657c2a

Observation 88d53d9a-68e3-4d94-a20c-796ddcaefb33 · outbound

This paper cites Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.184799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.184799Z digest=sha256:d9c0007e17ca85412af95ef21dd67a756997ed588f1028242c1be565d62e6436

Observation 490e0345-2ccd-49f8-9268-75f2dba23498 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.119972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:53.650564Z digest=sha256:457199213f3d93fdd0dee1d15531bd8b1fab6aff0b598e577bb3f4271d71122c

Observation f21874ac-4a1a-4e27-a05d-218b66c67ba6 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.869596Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:53.760144Z digest=sha256:a6c0a81c73de28436dde6dfa24dec49b107431852e4fea14d99e9ce7699fb538

Observation 92d68279-fd3b-495e-b407-5130aa6a3437 · outbound

This paper cites question.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.354945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:53.056558Z digest=sha256:ffc8e98341e771106d0bdd00f920f53f4d2d7b6ae339d7f189fe9f0f2ace6a02

Observation 8c169448-cf77-4e6d-a64f-fb11ff725b98 · outbound

This paper cites The question should require at least a university-level edu- 16 cation to answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The question should require at least a university-level edu- 16 cation to answer

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.069780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:53.223393Z digest=sha256:eac53e296c3a033dc94216ac335e9f233625b48a457f9e889a8aae6124a948d8

Observation c8d3db24-30ba-4abc-a30a-5457985c0f09 · outbound

This paper cites It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.702130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:53.382855Z digest=sha256:19afc58192e809df9293fdc607baabba07736c7a4b780dc995ab909668eb796e

Observation 1ff2388c-7163-49b6-93e0-7c2ae86a4909 · outbound

This paper cites The incorrect options should sound reasonable, but the content must be wrong.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The incorrect options should sound reasonable, but the content must be wrong

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.412736Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:53.528011Z digest=sha256:05a4b6ebb5497156312ff85a978a53c82c59f2f3aa05b09aecaa683090adf896

Observation b73682ae-bf53-4918-a876-6c98f4938c66 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.562780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:53.887089Z digest=sha256:c8b5c6c10d38e1eaae45b5e8d8c6d81490f118395b37f842749f801a0d64f319

Observation c3559958-5c7b-4771-a90c-4111c641973a · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.315170Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:54.079648Z digest=sha256:33389486da050b893c404e8be62966a5afa2771a655de9e10805b813487ecbf8

Observation d1618e54-79ed-486e-b4a3-41e34db3a655 · outbound

This paper cites Yes". If it does not meet the standard, output.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Yes". If it does not meet the standard, output

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.026681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:54.256510Z digest=sha256:9870887e404190d21f0a5f0d72c898603ff20d73f2e6e6c2fe4018723fee407f

Observation 16c83ba5-43f0-47a0-b1c0-2e10e76d1bb9 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.747944Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:54.410683Z digest=sha256:adc69c6acefda005e2c566559d6de39208bc0cfb847e9edf59d6ec4ded54f945

Observation 9ada5ac4-05f7-4503-b228-cbd879fbe380 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.473669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:54.546949Z digest=sha256:9cc682cdf02aebc1475758ec1acb5d45011da4ec2b19d3ee6a1ed276ae32c383

Observation 2bd093ad-9093-49c0-9253-a85e88c86a1f · outbound

This paper cites nbc 1" and.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models nbc 1" and

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:55.156106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:54.724615Z digest=sha256:f40380e8ae8e7b24f527230104a029738a4dfffdb475f9befe96d9c2869137f9

Observation 4528266f-5dca-4c6a-b9b0-2e26d855846e · outbound

This paper cites FinQA: A Dataset of Numerical Reasoning over Financial Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models FinQA: A Dataset of Numerical Reasoning over Financial Data

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.044053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.044053Z digest=sha256:5ac906c5bf69f0c237c4d5fd003322cd1934e04794ec059c54efea25937d415b

Observation 078f9fa3-f587-49cd-b0a1-b5275c0cc268 · outbound

This paper cites Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.623145Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:28:51.839113Z digest=sha256:7591da04d0f3fda9147f0f5afb1a500cd76ccc1efd056a4fed45d4d6804e6cec

Observation f76dcc90-76e7-4bf0-9de3-5bfc4bf1af09 · outbound

This paper cites HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:51.925610Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:51.925610Z digest=sha256:a9a6de00ba44b7c30ac6c680bf6faa54280b9a1953e11f843990cea0a52cc828

Observation 5607c524-dc4c-4466-9b7e-6d5f5f3351ce · outbound

This paper cites question_type.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question_type

Reference 2025

Resolution
malformed identifier
no resolver link, observed 2026-08-07T15:28:52.397552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.397552Z digest=sha256:f412fcd6df479744bfab3e5b1acaa83fcc663d2ba29e9301a4bebbb518c194c7

Pith citing papers

No inbound Pith citation observations are available.