Pith. sign in

Paper Citation Record · LEDGER

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators

As of 4 August 2026, this Paper Citation Record lists 18 of 18 outbound references and 2 inbound Pith citation observations for arXiv:2503.06778.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2503.06778 v3

Coverage vector

measured 18 of 18 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-22T23:59:27.228553Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-03T06:30:56.289259+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-29T21:36:22.389047Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-06-29T21:43:59.679289Z

Reference resolution

18 of 18 outbound references displayed

  • verified exact1
  • verified fuzzy7
  • unresolved10
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 036b47f6-3f3d-4a17-a733-fb33d56c5908 · outbound

This paper cites In 2012 IEEE International Conference on Intelli- gence and Security Informatics, pages 84–89.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators In 2012 IEEE International Conference on Intelli- gence and Security Informatics, pages 84–89

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:05:14.773332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:7c1a804ac2e64649314ce8809ba1bbf618dc11902989e9a71db0638551bbfb9b

Observation c7da2b9e-57c2-4e4f-849a-f43e1f0e1fb6 · outbound

This paper cites Martin Riedl and Chris Biemann.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Martin Riedl and Chris Biemann

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:05:14.769065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:3b1ad5e1df1b60439f814c5b7e607d63f0d331727c3af2661ca098bbec454bc9

Observation b32719bc-b44b-438a-b58d-6cdea0a1f50e · outbound

This paper cites Are Expert-Level Language Models Expert-Level Annotators?.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Are Expert-Level Language Models Expert-Level Annotators?

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-05-23T00:02:17.565591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:2315a97259b43219946be13e48c397ab8d35ed084c4a924c8792fb2e8f89e91b

Observation 78940c54-a6e8-45bb-863f-7b3b5390581d · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.765635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:8d2aa57e97d43c20ca969d9e342e01b3f298200d1cfde0036e5c6abb8dc09033

Observation c1fccb54-fbcc-4c56-85ed-7c7b8f67dd79 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.776536Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:3c1b78cb5ecc46f6a5e6a73bbadd6c4458a977d6d6eae6e19218c106ed4e828f

Observation 56babd15-2d77-4f40-b523-fa8ecef76607 · outbound

This paper cites State-level is excluded from the database.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators State-level is excluded from the database

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:05:14.762740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:03c083ae1a340ce756b447441451138d79129adb82f941870a3e68f68008e2b9

Observation 2027c533-d31f-433b-8727-97b8c6d54266 · outbound

This paper cites In terms of economic goals, the exclusive pur- suit of profit does not satisfy this criterion.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators In terms of economic goals, the exclusive pur- suit of profit does not satisfy this criterion

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:05:14.757144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:69321aebf604fb088e80934ffe3a02b534b12cf233f7082bb2c6878b56352de0

Observation c8c519cf-45f6-431b-9e67-81cb44fe4428 · outbound

This paper cites It is the act taken as a totality that is considered, irrespec- tive if every individual involved in carrying out the act was aware of this intention.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators It is the act taken as a totality that is considered, irrespec- tive if every individual involved in carrying out the act was aware of this intention

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:05:14.753745Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:3e352705e306782e58fe9bb794a6e86754eceeb012d250d33e8242683f5f27d1

Observation 3783e175-a87e-4cae-bb2b-2714000051ac · outbound

This paper cites That is, the act must be outside the parameters permitted by international humanitarian law, insofar as it targets non-combatants.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators That is, the act must be outside the parameters permitted by international humanitarian law, insofar as it targets non-combatants

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:05:14.750016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:770010793ced693f1970d9cacfd7e4cc2dac5b4e996b8dee5a95d3923766aa62

Observation c317fe2b-1c9b-4a0e-96db-c2a084999fef · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.746470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:6afaa3f6d5ba64662462fe239304d2f1a6c11326dec291038caa9a1903d84467

Observation d2fdc716-a724-4b63-9a36-ed76ccf4746e · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.742425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:98e0fa9e1a70fa65237ad496a2648ed875f4dff01350f8e767f477fac5882d37

Observation db7f8cd0-245d-4716-a4ff-6a9ac7067db4 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.738673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:de11c591cfc1eca6fc569237e4bae885b996cd5ec372e4654dca8e84e65082e0

Observation 9392907c-b11b-43c2-b39b-1ac4f4b7d82e · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.735815Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:88c014612942a461a76590ce5bcd9d21e15a56da1b2efc9cc8bc838c682cc4d3

Observation 1a047fa0-7667-433c-b240-6a13e5bbdbeb · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.732864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:570bdf9063d2c5cc1c629b5330f4a8a3b4c70beb52dc6abbe801091b539113d2

Observation d127e857-0606-4013-9d33-c91e4491e48f · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.729674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:c3d8a51244ee8f735ae271b671bb39cbfc89528543416055984bb39528c0212c

Observation a677b72b-abe8-48f7-b01d-cefec3203c38 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.726730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:5a78966c53c02caab7a0995f74c3b5ac8da48301ec768aba9104889db28b3b64

Observation 463ebff3-f767-4b85-8603-88ee38f77172 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-05-23T00:05:14.779558Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:84055c8490f7fba1cbf5729a2936e580c5076ba34f5c39a39e9906451fb09936

Observation 3e8c0690-ffbd-4535-bc4b-43b22c202345 · outbound

This paper cites Determine whether the following articles de- scribe the same incident: {article 1} {article 2}.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Determine whether the following articles de- scribe the same incident: {article 1} {article 2}

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-05-23T00:05:14.723584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-22T23:59:27.228553Z digest=sha256:1c0125078a72891af15d1fd59c4e1a1aae42a24022d7c6b83dc8eaa89039d70b

Pith citing papers

Observation de931b22-7eff-4ee5-b9b4-0f9d11984113 · inbound

SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Models cites this paper.

SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Models Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators

Reference 5

Resolution
metadata mismatch
local_arxiv, observed 2026-05-18T15:52:42.305774Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-18T15:52:27.652484Z digest=sha256:065593676b679198ddffe20e6dafa76fd41db2d5e6788496cda4f6d5e2c05f6f

Observation e3e9b147-a84e-4d9b-b1c5-8817be6572c5 · inbound

Double Triangle Annotation: A Scalable Human-in-the-Loop Framework for High-Precision Historical Document Annotation cites this paper.

Double Triangle Annotation: A Scalable Human-in-the-Loop Framework for High-Precision Historical Document Annotation Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators

Reference 1

Resolution
metadata mismatch
local_arxiv, observed 2026-06-29T21:43:59.680571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-06-29T21:36:22.389047Z digest=sha256:8277278c86da52c6039d08893874fea0fd3f6bd53d0f17f0cc8fe08bbf8d7510