Pith. sign in

Paper Citation Record · LEDGER

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement

As of 1 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 0 inbound Pith citation observations for arXiv:2605.06283.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.06283 v1

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-08T10:32:15.938575Z

measured 21 of 21 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-07-31T06:34:12.847434+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

21 of 21 outbound references displayed

  • verified exact1
  • verified fuzzy10
  • unresolved10
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9832c778-716b-484b-b9f1-5cc675053839 · outbound

This paper cites Can Large Language Models Be an Alternative to Human Evaluations?.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Can Large Language Models Be an Alternative to Human Evaluations?

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-05-11T20:01:10.260954Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:cde253694778a115403ba61e8fbcc0949a0c7cac934bd88ad707644d8d0de994

Observation 2168c922-7aec-494e-9e69-8aa812027445 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.946499Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:4d9677a816a8249b630e8dfdfdabbf03fd41543b8eab613eea7ba1863a1b89be

Observation d1237a91-29d5-49a1-917a-f8a67d8393c0 · outbound

This paper cites Each score point on that scale is described by an overall statement which captures the essence of the response.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Each score point on that scale is described by an overall statement which captures the essence of the response

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.968788Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:0aa7acc2419d1b4e5f45baf4cba390ffebb4367427421ebdb32c3a87581f54e6

Observation 0c46cafb-1e40-441b-bf80-62bd5d3ca631 · outbound

This paper cites Anchor papers are exam- ples of actual student work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Anchor papers are exam- ples of actual student work

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.951911Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:ce748d78e2ddf7779e18654f42439356a26b87a79d038200077c49d46e7d44b1

Observation 071fadc7-f3a8-48c0-8602-38f952d9b725 · outbound

This paper cites Also, papers receive a score based on the work the student did complete even if they seem to be unfinished.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Also, papers receive a score based on the work the student did complete even if they seem to be unfinished

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.954280Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:acf56d79c588c45ef6e017c0ad3ee3254f896501ea22e317f82d4b73a7da0fb8

Observation 9fd1820f-9b93-4beb-9c57-2481277c4c83 · outbound

This paper cites Prompt 4 Holistic Context Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Prompt 4 Holistic Context Instructions

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.949154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:b5afbe0a222146e0910e0790aac277418d9c34f0a50d4ec743de79fbd695f986

Observation 842ca462-28d4-4554-8dc3-0e2c92ed037e · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.963124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:5f6bf90dcf433d3cbdf09c4fc171ace503d7bb6250b7569b3e0a97247ed99472

Observation ca8167d1-4fc0-4873-a1ea-e2c85db5f02a · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.959940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:53c4c7c5a9a790388609586e61f67abd31060709a0e293c449be53b8d576af60

Observation c457ad2e-a217-446e-901f-83be0a7d8559 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.965503Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:bf9280c29ebd1cabba2d957e0f3f1de07ccff59b344727aa6fd546d5a1cf7435

Observation 2c6ac5b2-8e7a-4d94-8246-61442080613b · outbound

This paper cites Prompt 6 Holistic Context Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Prompt 6 Holistic Context Instructions

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.957378Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:99600c2097e115cd27f558e65fdba5a57f7616a28aa445d9374aa331801b9c4d

Observation 34e0ee1f-039c-4e93-b4e6-9f3a7337224d · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.915697Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:c82f113cde322f16033e3e9596d37a16043e11f3f2a580e324f8c4931d765919

Observation 5e7bd8bb-6ecd-44a9-b5cf-90b3d652c8c3 · outbound

This paper cites You are not a teacher, substitute teacher, support staff, tutor, administrator, etc., who is currently under contract or em- ployed by or in schools, or under 18 years of age.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement You are not a teacher, substitute teacher, support staff, tutor, administrator, etc., who is currently under contract or em- ployed by or in schools, or under 18 years of age

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.929615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:b87f9ac409e0f811fe21986b102bb64296474e4088bcf206090334539f61cf78

Observation 50839513-2525-4031-8747-3874af932a13 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.943722Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:aa439572b9a76e9efbee7270ae996a3b3e74c4ca877de7c5c4336608e122bf5f

Observation dfe17bba-663a-4bad-a68c-58f25dabe1a0 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.925041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:1a2ba870cc7d7b34e4552d487c8ca1f659cbce80e91dcf0a89eedf6902a9cf34

Observation 3cf3b326-37a5-482e-9f46-fa3d81baa3e3 · outbound

This paper cites Example of context given to an analytic prompt for separate (Prompt 1) Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Example of context given to an analytic prompt for separate (Prompt 1) Instructions

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.921770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:ceb857e939c9e4b386591f2836308d1d1aae068f1b670d8ca3b7fc4a7beda98e

Observation 7c702ef3-d4c9-4a90-892a-683aecd3a20c · outbound

This paper cites Example of context given to an analytic prompt for edited (Prompt 1) Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Example of context given to an analytic prompt for edited (Prompt 1) Instructions

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.940942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:1a11533e0149abc43d06445e1648703a22fd1f086b73a3fdb2b44b40042e6d62

Observation 37904974-f614-4ba9-b39f-a37c82178661 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.932227Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:283ed37bc6c3f81cf37fa38ebbea661690c18a38ee212519982ae6d0682e39d8

Observation fb5b094e-b31e-4552-a78e-2326a8bfe01a · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.937936Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:43b5e781c952b61c119217f10d2473061fe7ea4a80a5f41580da157f67bacc58

Observation a00ce2cd-227e-40c1-a1b1-c1ed8d50bed8 · outbound

This paper cites Anchor papers are exam- ples of actual student work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Anchor papers are exam- ples of actual student work

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.910825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:7cde29e18069a88c6fec1f3bf4e6ab775428fa417f8f86654c4313484f12a48b

Observation 9175e785-005a-4f54-82a2-df6566d28cab · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.918783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:2ff34e7316ef1eb8fe9178289618be817568e23b5320d8fa1de0e18e242849d7

Observation a52a8574-f2de-425c-b9da-af52fab6b024 · outbound

This paper cites Does each sentence in the generated text use a second person?.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Does each sentence in the generated text use a second person?

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.935322Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-07-31T06:34:12.847434+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:8bec62c87478de13c6c243b685eb470d7d5d872d4e76818e7c26c3806bd93345

Pith citing papers

No inbound Pith citation observations are available.