Pith. sign in

Paper Citation Record · LEDGER

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models

As of 8 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2505.15094.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15094 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:28:54.724615Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

  • verified exact0
  • verified fuzzy10
  • unresolved9
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation f8798d0d-70ce-4337-a32a-e225fd48601e · outbound

This paper cites Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.318916Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:52.588990Z digest=sha256:de6d967cf29a6a54b7951b497a5ef2a0cbf77747fd1a543645a4127d895f7b8d

Observation f160ef1d-ea84-411d-b4b2-465306eb50db · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:59.055039Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:52.741538Z digest=sha256:2b358aa0e2567a09dfc95b36822717590b4b94c38a56a38da1dc255244d00e51

Observation 02420a4d-3df6-4e17-a903-71ed5ef4739b · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:58.697425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:52.915943Z digest=sha256:e79e4855f85ffe0ff1eeaecb465ce84d8c09d69d86b8fed208b0a55aadfd5b25

Observation 88d53d9a-68e3-4d94-a20c-796ddcaefb33 · outbound

This paper cites Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.184799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.184799Z digest=sha256:e1ab7a6604a01bb550bb58ec432626b3314febb2b735165819202ee801105837

Observation 490e0345-2ccd-49f8-9268-75f2dba23498 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.119972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:53.650564Z digest=sha256:0f7e9d5f7ec668570982192e39ae58d53d6a0ee23dc29f0c3838adacefe5a91e

Observation f21874ac-4a1a-4e27-a05d-218b66c67ba6 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.869596Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:53.760144Z digest=sha256:0c9c69b857f0105ed550832cc8daff3ab20c61a1dbe3d0446bd85f09c1dcfe5b

Observation 92d68279-fd3b-495e-b407-5130aa6a3437 · outbound

This paper cites question.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.354945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:53.056558Z digest=sha256:2575fee6e171efa5ffc146af8be0c0e5163199f84c105bf1ee8a08a7cd34d589

Observation 8c169448-cf77-4e6d-a64f-fb11ff725b98 · outbound

This paper cites The question should require at least a university-level edu- 16 cation to answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The question should require at least a university-level edu- 16 cation to answer

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.069780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:53.223393Z digest=sha256:095d406a506fd554b37b9639ba4328c83263850ff19266a25ea3496a5c7eaf91

Observation c8d3db24-30ba-4abc-a30a-5457985c0f09 · outbound

This paper cites It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.702130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:53.382855Z digest=sha256:ead27ebd7217c4160ea29d48f4544becf52fe817f4adb185e704355d3512590f

Observation 1ff2388c-7163-49b6-93e0-7c2ae86a4909 · outbound

This paper cites The incorrect options should sound reasonable, but the content must be wrong.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The incorrect options should sound reasonable, but the content must be wrong

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.412736Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:53.528011Z digest=sha256:01b2838b7928e124cf17af5d6bd81d04c6a41ad1b2731a8190be19dbc95a5f79

Observation b73682ae-bf53-4918-a876-6c98f4938c66 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.562780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:53.887089Z digest=sha256:b6b6f653360688f30f05d0b5cad6edd33bfadab18b306db7b8df75a403260317

Observation c3559958-5c7b-4771-a90c-4111c641973a · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.315170Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:54.079648Z digest=sha256:0e1e2fbb966c4e8b41f9844fc4038d9ec645ad9825ba4b9bcb7e8a09a6d5b340

Observation d1618e54-79ed-486e-b4a3-41e34db3a655 · outbound

This paper cites Yes". If it does not meet the standard, output.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Yes". If it does not meet the standard, output

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.026681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:54.256510Z digest=sha256:91305f00fa0d0bb58a48d06962e97194636f77ab4a29ba7d6bf4405d611d45fd

Observation 16c83ba5-43f0-47a0-b1c0-2e10e76d1bb9 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.747944Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:54.410683Z digest=sha256:7fdc044f7f37d5bc8a656f338caf1ea5f29924cf5b459eb7d0cf0807303b7465

Observation 9ada5ac4-05f7-4503-b228-cbd879fbe380 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.473669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:54.546949Z digest=sha256:d6dc0ea9834a29004d156b12f4a0e9d33f9e10a1496afad96b3c32c0a9d4eb3e

Observation 2bd093ad-9093-49c0-9253-a85e88c86a1f · outbound

This paper cites nbc 1" and.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models nbc 1" and

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:55.156106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:54.724615Z digest=sha256:6898554454e4bc5c5e1fa749c54bf9c063394e7553778dd659b9217670d085db

Observation 4528266f-5dca-4c6a-b9b0-2e26d855846e · outbound

This paper cites FinQA: A Dataset of Numerical Reasoning over Financial Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models FinQA: A Dataset of Numerical Reasoning over Financial Data

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.044053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.044053Z digest=sha256:864e470208ceb513ef1e66a870601b32bd9523cc7a3ead4f09d2047f45f9c580

Observation 078f9fa3-f587-49cd-b0a1-b5275c0cc268 · outbound

This paper cites Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.623145Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:28:51.839113Z digest=sha256:1e33e21693fb53078081abea1fb0c28a76ccc55d8ebc3747588f91279dedb330

Observation f76dcc90-76e7-4bf0-9de3-5bfc4bf1af09 · outbound

This paper cites HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:51.925610Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:51.925610Z digest=sha256:f81d0ab2be6540dbcf2c73478feaf38e6087c93f440e559ba0444087a17fb250

Observation 5607c524-dc4c-4466-9b7e-6d5f5f3351ce · outbound

This paper cites question_type.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question_type

Reference 2025

Resolution
malformed identifier
no resolver link, observed 2026-08-07T15:28:52.397552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.397552Z digest=sha256:c3f0952c7aab69f808671e85a13f1d23f3e6fa0faeb39007326c727f77222b7c

Pith citing papers

No inbound Pith citation observations are available.