Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-05-10T16:20:44.551760Z
Paper Citation Record · LEDGER
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment
As of 28 July 2026, this Paper Citation Record lists 20 of 20 outbound references and 1 inbound Pith citation observation for arXiv:2604.11543.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-07-28T06:31:03.373048+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-07-11T19:11:37.739920Z
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
20 of 20 outbound references displayed
- verified exact4
- verified fuzzy15
- unresolved0
- parse uncertain0
- malformed identifier0
- metadata mismatch1
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation eafd7f3e-a649-47d6-a7bb-8b9ae0975af5 · outbound
This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Reference 1
- Resolution
- verified exact
- local_arxiv, observed 2026-05-11T09:00:59.495696Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 549321d4-00f7-49dd-8656-19a035c7dd3d · outbound
This paper cites Reviewer2: Optimizing Review Generation Through Prompt Generation.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Reviewer2: Optimizing Review Generation Through Prompt Generation
Reference 2
- Resolution
- verified exact
- arxiv_id, observed 2026-05-11T09:00:59.510291Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation b167f2c2-79f3-4de0-998d-0323b8fbeb2e · outbound
This paper cites Qwen3 Technical Report.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Qwen3 Technical Report
Reference 3
- Resolution
- metadata mismatch
- local_arxiv, observed 2026-05-11T09:00:59.506448Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 63383334-3769-4905-a759-e0ccc87bb527 · outbound
This paper cites In this paper, we propose a novel transformer-based architecture that integrates syntactic information into language modeling.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment In this paper, we propose a novel transformer-based architecture that integrates syntactic information into language modeling
Reference 4
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.690274Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 0eb517ab-6a4a-46ce-8f8f-0580acba526a · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 5
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.698838Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 72de0aff-8759-4edd-aa05-23afe4915516 · outbound
This paper cites new” or “novel.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment new” or “novel
Reference 6
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.687412Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 94dd6201-2778-4c0a-8a30-9a7329312a30 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.701173Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation c725fa04-ab54-463d-a369-97f581cb76c2 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 8
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.703886Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 56785e2a-4cf8-4a0d-a3f1-45a313b764a2 · outbound
This paper cites Model Rel.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Model Rel
Reference 9
- Resolution
- verified exact
- arxiv_id, observed 2026-05-11T09:00:59.517496Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation f0a9b020-82c1-478f-bf94-b814151b25fc · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 10
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.691927Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 994c9fba-8ee9-488f-98f0-8a0daf603174 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 11
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.710497Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation ee18ed52-e0c6-4146-8f77-0da3becbcf71 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 12
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.706728Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation e02ed532-d340-49e3-b8a2-c4f170d9db5d · outbound
This paper cites Positive.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Positive
Reference 13
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.701873Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 5bebbff7-f2a0-4837-b2bc-1bb4089855bc · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 14
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.677264Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 3198bb5c-e29e-4549-97b8-a4ca65fb4bb7 · outbound
This paper cites Positive.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Positive
Reference 15
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.679943Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation abca0b71-f0a7-4ed0-a5bd-923c80450c65 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 16
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.674403Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 3e3f5e1a-e356-4cf4-8db7-6890c4dc7233 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 17
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.671690Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation 55b7180e-8425-41f7-9858-936e1378c8f3 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 18
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.682544Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation ef92de0c-610f-46fe-b46f-03f60cfbc9f7 · outbound
This paper cites an unresolved cited work.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Unresolved cited work
Reference 19
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-05-17T15:51:55.685126Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Observation ec5b6199-75b3-4877-b1da-c98080b75e3d · outbound
This paper cites Discriminative Reasoning for Document-level Relation Extraction.
NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Discriminative Reasoning for Document-level Relation Extraction
Reference 20
- Resolution
- verified exact
- arxiv_id, observed 2026-05-11T09:00:59.514014Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-07-28T06:31:03.373048+00:00.
Pith citing papers
Observation 2c66d0b1-a6ba-411f-9315-b777d9679cfd · inbound
ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes cites this paper.
ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment
Reference 56
- Resolution
- unresolved
- no resolver link, observed 2026-07-11T19:11:37.739920Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.