Pith. sign in

Paper Citation Record · LEDGER

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews

As of 5 August 2026, this Paper Citation Record lists 27 of 27 outbound references and 1 inbound Pith citation observation for arXiv:2604.19502.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.19502 v2

Coverage vector

measured 27 of 27 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-11T11:50:26.030339Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-04T06:34:03.388597+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T04:52:00.834543Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

27 of 27 outbound references displayed

  • verified exact1
  • verified fuzzy13
  • unresolved12
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 3442dd42-0843-4151-988f-701da98869ba · outbound

This paper cites OpenAI GPT-5 System Card.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews OpenAI GPT-5 System Card

Reference 1

Resolution
metadata mismatch
local_arxiv, observed 2026-05-10T02:11:56.973494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-07-11T11:50:26.030339Z digest=sha256:7cc642b0de87c032009ea00f805abd1da7618a79aa7defa36724c27bfb833eb5

Observation 076bbd1f-ebf3-41e6-9e75-b590639385b7 · outbound

This paper cites Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-11T13:11:23.496191Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:80c621196c03ed2fce1f85a42f3d650f5cee10244ff4839483043d63c82461df

Observation ee13770a-8d63-4782-97f3-c2a4e48368c9 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.568298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:20cea1d2215aa56bcba33e931c3b3ee00b7331e96860888dcc0c1b978c172fed

Observation 4b3e876f-9359-4a1b-a731-bbeda4b458ff · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.540517Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:ed9fd37a8c3700682291fa709268ff643576380d1efdec1fba4a5d14b50a4e06

Observation 7e49d690-278e-41e3-8ce7-a32c9c8f89a6 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.570725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:d00078d9155639d1462204e0d0ec789aebecde3ec57c6da105a9c93042218b70

Observation a912e0ea-9024-4376-85aa-b6961b7a0acf · outbound

This paper cites Output JSON: {.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Output JSON: {

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.536250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:4496ff2eb55c8854cb6a950d4ebcab69a6b760884de5905d379b81797a82e23b

Observation 31b8d70a-7bc8-4dc7-a0f3-2526a9429094 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.521540Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:c5b418f49c78542a7c03f430bda13468f3bbefa9fa8aac349628fd902749edae

Observation 59822e2a-08f1-4edb-bb96-d512793a28fa · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.547734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:5df2cc00bbfb3d993cac9d6173cb4df693da33c6e573324b86291e207cd9a151

Observation 9170e825-c9de-4b5e-a789-b1868db9a046 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.575110Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:b72b9fc134d5894c37f883d2491f022263d0972823025537f5985c670f3c9b57

Observation 55b5af7e-29bd-4c76-ae53-b317446f7a1f · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.545217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:ec5cfb8d70d4819a8b5880682ac9792572257c17799c0deb5355e139f2463362

Observation 12b1b725-00e7-4025-a685-c33f1a2959ef · outbound

This paper cites Output JSON: {.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Output JSON: {

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.528875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:fe90da865121f0a64c2b4d5e6c8631f0b049bf519afaefcaa1d81c54c990e0a8

Observation 2ebba881-0d60-47df-986f-c587ee6dee21 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.552816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:8fdd7e5e547b1cb4f333e6f61b0193cee26b121a5a577c3fff63358640e269c9

Observation 45a10b5d-8f2b-49d3-84e5-ceddf8b199dd · outbound

This paper cites yes" only if they describe the same point; loosely related or overlapping topics are.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews yes" only if they describe the same point; loosely related or overlapping topics are

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.556970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:905ddd71c17d9359556a81fba42268f4c6009317fd12dc1d1ff51bda2cdf764c

Observation 6cbce760-c54a-427f-acce-197eb1286e6c · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.554755Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:9f0c59f22e2b76da125088d63ae4b791567dd9a11f5eaf6d0806f41fc200f802

Observation 64e31fab-a975-439c-a415-8f06f48a773d · outbound

This paper cites why" or.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews why" or

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.524045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:d827b16d3b9130a3dd5f4f32283d3e66c97f6ebf2c72c66df1599e3bc89c4317

Observation cdf8a53a-3020-4fc4-bee8-923df89288b5 · outbound

This paper cites yes". - **Assign.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews yes". - **Assign

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.561516Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:8a1be3e8da21d0e87d67ef322456c36655cc717535a8f749a0196775a43a8cd1

Observation 1c14f27c-be88-4128-a2f0-568a45e8429c · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.531339Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:6b6e58b7b8c5e36f896eeed979229defc324459cd59e2ed955bed3272e0c3c73

Observation fc3ac65e-fb1b-449f-9fb3-82435aec043d · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.566077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:e60e0566ade8e764b2f3074cd6ff2bd0a0d23df844745217f2353a30b805ded5

Observation 92d021d5-8389-41be-ae4c-1b8644ba1bd9 · outbound

This paper cites yes" for keyword matches alone; the explanatory intent must be satisfied. 29 Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews # Output Format {{.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews yes" for keyword matches alone; the explanatory intent must be satisfied. 29 Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews # Output Format {{

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.563879Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:236f87386662e6f46ff6e5396965c54efae32f0a07787a79f69c197710c2def0

Observation 5fd12722-8c61-430b-b8b4-d498dd913593 · outbound

This paper cites This category captures assessments of whether the work introduces new ideas, methods, or perspectives that advance the field.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category captures assessments of whether the work introduces new ideas, methods, or perspectives that advance the field

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.519305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:018eb88a94a129b925d76d64727495c1eec8012c903a45396b7ad25e948cb802

Observation 1087915b-8e0a-4ffc-b21c-7aed34f25027 · outbound

This paper cites This includes assessments of mathemati- cal rigor, logical consistency, and methodological validity.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This includes assessments of mathemati- cal rigor, logical consistency, and methodological validity

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.550549Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:b6e75019c5ca9552c29ad8f27c4970446c1f4b274d4fc4d476a1013f111ed7c3

Observation e64ccbe9-994e-429f-9fb9-ca95b9673e5e · outbound

This paper cites This category includes evaluations of experimental setup, data quality, statistical analysis, and result interpretation.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category includes evaluations of experimental setup, data quality, statistical analysis, and result interpretation

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.559250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:ad3e5ac0dddfb6d4664a809898f7383e673eb0186e33f2e2a60efac04c131fd2

Observation 17a5e7a1-9c57-4c7f-9fee-86f006a12aa6 · outbound

This paper cites This includes assessments of paper organization, writing clarity, figure quality, and overall presentation effectiveness.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This includes assessments of paper organization, writing clarity, figure quality, and overall presentation effectiveness

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.534144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:d8f112b765656676aef3f9f691f57ed8d76cb69afbe16d1941d23bcd8332d9d4

Observation e9510c24-a87b-4d54-be0d-68f683ac517d · outbound

This paper cites This category captures evaluations of the work’s importance, potential applications, and contribution to the field.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category captures evaluations of the work’s importance, potential applications, and contribution to the field

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.542946Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:c7707d6b16f6ddf0ada0fad16019d0d5bf7f364a8a72271442b58aa20d9b4dec

Observation b00b8b82-98cc-4af3-af38-8809600f2f38 · outbound

This paper cites This includes assessments of whether sufficient information is provided for reproducing the results, code availability, and parameter documentation.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This includes assessments of whether sufficient information is provided for reproducing the results, code availability, and parameter documentation

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.573102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:ea997dc8a93926a89a033e983c253acf672d735d8965c81ce74d2a81ce5a4621

Observation 22c692aa-3588-4559-9e16-27a454011c07 · outbound

This paper cites This category includes assessments of whether relevant prior work is properly cited and discussed, and whether the work is properly positioned within the existing literature.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews This category includes assessments of whether relevant prior work is properly cited and discussed, and whether the work is properly positioned within the existing literature

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:27:18.526529Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:d88ad77c16e84d65bb77541459b8488f7b48fa115e10a2d67d48662fead9aede

Observation 35b4eed7-7731-453c-bfa4-0f4b1b181321 · outbound

This paper cites an unresolved cited work.

Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:27:18.538229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-10T02:11:04.169104Z digest=sha256:c8f4dfd6c4e7ce3bf85dd3d24703832bbc0dd2200e3100c247e5078f158f298e

Pith citing papers

Observation eb520d27-456e-4a95-9e39-2d11f7f5683b · inbound

RubricReviewer: From Direct Critique to Objective and Comprehensive Rubric-Driven Peer Review cites this paper.

RubricReviewer: From Direct Critique to Objective and Comprehensive Rubric-Driven Peer Review Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-04T04:52:00.834543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T04:52:00.834543Z digest=sha256:0ab35c0cec41f49d1746bbe1eda7969e5a2aea269ea36b50204cd00230f66e73