Pith. sign in

Paper Citation Record · LEDGER

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models

As of 10 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2505.15094.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15094 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:28:54.724615Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

  • verified exact0
  • verified fuzzy10
  • unresolved9
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation f8798d0d-70ce-4337-a32a-e225fd48601e · outbound

This paper cites Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.318916Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:52.588990Z digest=sha256:9c12fd2229813845c1dc202faf3415e0c504492b8e921bf6459ba762c4cf321a

Observation f160ef1d-ea84-411d-b4b2-465306eb50db · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:59.055039Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:52.741538Z digest=sha256:ea31b10fa3b5a157fa4f2e27feda22b97a4f418212127ece648ade7802068c24

Observation 02420a4d-3df6-4e17-a903-71ed5ef4739b · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:58.697425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:52.915943Z digest=sha256:7b735df69b03eae660692a030251e05d607010d3332bdfc13c4fcadadce9c379

Observation 88d53d9a-68e3-4d94-a20c-796ddcaefb33 · outbound

This paper cites Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.184799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.184799Z digest=sha256:52ff41e7541ffeda867f4893349bf5051b7b9042195256b641e3a79ed2162c59

Observation 490e0345-2ccd-49f8-9268-75f2dba23498 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.119972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:53.650564Z digest=sha256:dc85a3765a4658bf5c05396d146eced3921923af1d078dd22e90ef0fb160704c

Observation f21874ac-4a1a-4e27-a05d-218b66c67ba6 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.869596Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:53.760144Z digest=sha256:88ff443a2c6df1eb32340fb0fb078ba94e89f214f1c0ee0f1aab35c80b3dabca

Observation 92d68279-fd3b-495e-b407-5130aa6a3437 · outbound

This paper cites question.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.354945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:53.056558Z digest=sha256:9004f05b10f82deaa41b935076fcbc97c6dd755e186a7259fe96610179212320

Observation 8c169448-cf77-4e6d-a64f-fb11ff725b98 · outbound

This paper cites The question should require at least a university-level edu- 16 cation to answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The question should require at least a university-level edu- 16 cation to answer

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.069780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:53.223393Z digest=sha256:22427d93a11c1f5778c2479ae4f784fe16b7994a04eb93734eed08e8f3771c38

Observation c8d3db24-30ba-4abc-a30a-5457985c0f09 · outbound

This paper cites It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.702130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:53.382855Z digest=sha256:6fab094484308bee54e084f8e4f4bfb91f912f9bb2b3116f56265eedac7423f4

Observation 1ff2388c-7163-49b6-93e0-7c2ae86a4909 · outbound

This paper cites The incorrect options should sound reasonable, but the content must be wrong.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The incorrect options should sound reasonable, but the content must be wrong

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.412736Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:53.528011Z digest=sha256:453bc37afa51b1df17eb0d583bc75f7e30a9574ac1566e9696b9aa42a495a8f5

Observation b73682ae-bf53-4918-a876-6c98f4938c66 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.562780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:53.887089Z digest=sha256:af5cf795d3cfa34bce2cd6354727af36923a9737ce4f6eaabe1a7da71720970b

Observation c3559958-5c7b-4771-a90c-4111c641973a · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.315170Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:54.079648Z digest=sha256:18d8217b194c28b7f02c609e776cdae6336a4749bc80084639c0f33403af157b

Observation d1618e54-79ed-486e-b4a3-41e34db3a655 · outbound

This paper cites Yes". If it does not meet the standard, output.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Yes". If it does not meet the standard, output

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.026681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:54.256510Z digest=sha256:38e5a45a016229c7e27ae73cd1ff4ac9c71341b49ae0ad31c297a154edff2bc7

Observation 16c83ba5-43f0-47a0-b1c0-2e10e76d1bb9 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.747944Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:54.410683Z digest=sha256:d02e713b8618ac0c190fb190e960aa1cb44f931f0715ba4db787a94d4170e4fa

Observation 9ada5ac4-05f7-4503-b228-cbd879fbe380 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.473669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:54.546949Z digest=sha256:51a82b18ee310040aa9a777ddcf7a48d1fb559da8e9e36248382d4eed02085d5

Observation 2bd093ad-9093-49c0-9253-a85e88c86a1f · outbound

This paper cites nbc 1" and.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models nbc 1" and

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:55.156106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:54.724615Z digest=sha256:672dce6b5675c5361b8a2b3e85b56b6eddea0a2485cddfa456b0d11aa63691e3

Observation 4528266f-5dca-4c6a-b9b0-2e26d855846e · outbound

This paper cites FinQA: A Dataset of Numerical Reasoning over Financial Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models FinQA: A Dataset of Numerical Reasoning over Financial Data

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.044053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.044053Z digest=sha256:c3eabcfaf7dc320407af181d322a5743aae8024ade4c1042e58aadfb84a2dfca

Observation 078f9fa3-f587-49cd-b0a1-b5275c0cc268 · outbound

This paper cites Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.623145Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-07T15:28:51.839113Z digest=sha256:d29bef4f3bb4d5a5b82a0fc404fc5115b1bee043d85ef0571d47cbaf78bfd2e8

Observation f76dcc90-76e7-4bf0-9de3-5bfc4bf1af09 · outbound

This paper cites HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:51.925610Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:51.925610Z digest=sha256:49d1b9565b105d0891e6c5f3c148b315bacc16b5d5600ff39c7b409f6ff89210

Observation 5607c524-dc4c-4466-9b7e-6d5f5f3351ce · outbound

This paper cites question_type.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question_type

Reference 2025

Resolution
malformed identifier
no resolver link, observed 2026-08-07T15:28:52.397552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.397552Z digest=sha256:c3b947ae4667d20f1903942a551d47fbb7c947993192db7c1cef1dab1beb799d

Pith citing papers

No inbound Pith citation observations are available.