Pith. sign in

Paper Citation Record · LEDGER

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization

As of 20 August 2026, this Paper Citation Record lists 26 of 26 outbound references and 1 inbound Pith citation observation for arXiv:2505.02172.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.02172 v3

Coverage vector

measured 26 of 26 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T01:03:47.009487Z

measured 27 of 27 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T05:56:03.443358Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-10T05:56:10.838739Z

Reference resolution

26 of 26 outbound references displayed

  • verified exact0
  • verified fuzzy2
  • unresolved24
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e7662773-9bd5-420b-ac9f-f701756a5580 · outbound

This paper cites Language Models are Few-Shot Learners.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Language Models are Few-Shot Learners

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.927240Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.927240Z digest=sha256:b30209f17c1959f781196427c54347ac87e32960dc60aab0a11702b26ac5a381

Observation ce7d747f-0a31-4707-9df2-1439966f55a5 · outbound

This paper cites LexGLUE: A Benchmark Dataset for Legal Language Understanding in English.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization LexGLUE: A Benchmark Dataset for Legal Language Understanding in English

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.930667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.930667Z digest=sha256:63f9e4489ac93fb9645879d3bda4d2eccc28aeb65572aed85cd292cc87fd858d

Observation 74a7b97c-742c-40ea-9c36-6477d43b32bc · outbound

This paper cites TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinement

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.933753Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.933753Z digest=sha256:5371355cf2de359fa7b13efc93213c912e51d4fb726f6e25e24c2d3ba10dc454

Observation 1dbbb37a-3f46-4787-bb49-11153728760b · outbound

This paper cites an unresolved cited work.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-16T01:03:47.191694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.936750Z digest=sha256:cd47262b8dfd7f6b0d9924c0a8bcad2924b2a3514c272393c22c7def7629f6f9

Observation af9ad17c-8bfb-4823-b8ca-ea4ca7036b1b · outbound

This paper cites SoK: Memorization in General-Purpose Large Language Models.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization SoK: Memorization in General-Purpose Large Language Models

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.940372Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.940372Z digest=sha256:63bd19c6cb079bd1fdabd51b3f7080662a39e6a96324c63b22dcc99ffd3979d1

Observation 3df06d5b-ebd5-4425-a0b5-ab9d673f63a2 · outbound

This paper cites Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.944751Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.944751Z digest=sha256:bcc7205437836bf6fe8195c3b3b0d577011b8e5028818c8b86209d7ab9e6fcfc

Observation 595dfe9b-34f4-4e52-b52e-b09614f93065 · outbound

This paper cites Scaling Laws for Neural Language Models.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Scaling Laws for Neural Language Models

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.947838Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.947838Z digest=sha256:7a489ca50d464ee2b243c68a9f63ef65d1f7dbe588840bd98c39ba9df5caa6a9

Observation bccc453a-365b-4f20-8f1f-43951f5270b0 · outbound

This paper cites Natural Language Processing in the Legal Domain.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Natural Language Processing in the Legal Domain

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.951310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.951310Z digest=sha256:a6a38b4169b4ac46ef54395ba8eb3d8a29604e61211f9751a4c4ecfc550a01e6

Observation 8b40cdca-aaf9-4ac0-ac1a-7d0cb849c999 · outbound

This paper cites an unresolved cited work.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-16T01:03:47.184747Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.953965Z digest=sha256:ac4078462254d6786cc4c449edf40793a751568e39335f673c92a451eb2b732a

Observation 702b725f-940e-46d8-bbf7-bdc6862f12ed · outbound

This paper cites Mapping the Increasing Use of LLMs in Scientific Papers.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Mapping the Increasing Use of LLMs in Scientific Papers

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.957342Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.957342Z digest=sha256:3730aa2b32a5924aa66d65b57ae51c7ac858557661c1dddfea05b8f03674c065

Observation a459f5d7-0655-495d-aac0-4f243828342a · outbound

This paper cites Mellinkoff.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Mellinkoff

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T01:03:47.176381Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.961556Z digest=sha256:145f62a9c30639ed157af76d47465ddabe3c808503742371a4697baab03606f1

Observation c899c309-f527-4cfa-a903-2646b7bbd87a · outbound

This paper cites an unresolved cited work.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-16T01:03:47.169070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.964637Z digest=sha256:e90e0c207bbc795b8da7a433b105b60273cfb4627dbfd1a8edfd71f8a4604730

Observation df023593-d7b2-4afc-8be0-fb2f715d0866 · outbound

This paper cites MultiLegalPile: A 689GB Multilingual Legal Corpus.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization MultiLegalPile: A 689GB Multilingual Legal Corpus

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.968344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.968344Z digest=sha256:165c05d2a32323f6387c9e7a7c48f209f96dbb98448e3298d3187116998dd0f1

Observation a28bf9ce-488d-41ce-8fa0-76f21edf9e5c · outbound

This paper cites an unresolved cited work.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-16T01:03:47.161478Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.971300Z digest=sha256:bec381fab8fe204e08dac0c9ce74a31c6d02452b93b60c097784c077456744df

Observation 2f6ac44f-6c7c-4876-a851-45765cb51328 · outbound

This paper cites GPT-4o System Card.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization GPT-4o System Card

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.974539Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.974539Z digest=sha256:34905cd4c9a3f2aa5e4e501ce30d6c5e4add5c4b33490cf273f406a29fb40d26

Observation 0442d9d6-3cfa-4a0e-8560-2f13e029f4d3 · outbound

This paper cites The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performance.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performance

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.977332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.977332Z digest=sha256:0b5157e1767a8ab1e8ea20a69b50f5c40deedb2ad1a73e5662f312f5c2839756

Observation 8ac6c14e-9e6f-4d55-b824-6570d9a155cc · outbound

This paper cites an unresolved cited work.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-16T01:03:47.153062Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.980670Z digest=sha256:26c704947dedaedb276b16565610af42b051eaa94ab15f5294b060ab6a248909

Observation e3fe99b6-fdbe-4bcc-b80e-6bd01d71c96f · outbound

This paper cites Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularities.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularities

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.983777Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.983777Z digest=sha256:d0535a1920eaeeb9e952f906a90cca4a2cc0d874b55d61c9a59a68e22b0bbe81

Observation 275ad312-6be6-47de-aef8-9dacb1c38718 · outbound

This paper cites Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.987285Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.987285Z digest=sha256:53275d3091090b32f6b3c5c18d2103d809a5a1c3b35d12f0ebeccfc041ef09f3

Observation 23ca2fc4-ce47-4f89-ba7f-d027c1a30309 · outbound

This paper cites an unresolved cited work.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-16T01:03:47.143403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.990655Z digest=sha256:66172149a89114ebb511957868d4c61d0c57dd2086b7a2ba020c6b6d54194021

Observation 4424d8c2-330c-479c-aa69-c38216b0dd87 · outbound

This paper cites William Webber.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization William Webber

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T01:03:47.136389Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.994077Z digest=sha256:ba3cc00926589c93aa94eb10391a6d9a9bbed2173e22ec5e3322609d4bf24045

Observation 0257b87d-7546-4d85-8898-84cbd2b0ec43 · outbound

This paper cites an unresolved cited work.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-16T01:03:47.128215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-16T01:03:46.996592Z digest=sha256:101bd2b25f77596ccb325846fb4b97a27af4fb4b7b764afc835efaa5c86f322c

Observation 45361f28-2410-4d73-820f-39cf9e38210d · outbound

This paper cites Planning In Natural Language Improves LLM Search For Code Generation.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Planning In Natural Language Improves LLM Search For Code Generation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:46.999852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:46.999852Z digest=sha256:60cfd88bda0bc1c03d217a7ea54b44e29731b20b7e1eeb36a8e444bdeaadf5a7

Observation d3d7a714-469e-4fbb-9875-c7b342703487 · outbound

This paper cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:47.003194Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:47.003194Z digest=sha256:826a770fa3670813ab70a8798a2eecd3a1fcf50a3b75c9153d7a3c0973229133

Observation 6cb974e2-e372-4204-9fb7-045310b7c20d · outbound

This paper cites When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:47.005670Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:47.005670Z digest=sha256:317bff704f7a86e57802265cadc8e3defb22b4bc3fd057db5f5f168b453b52c0

Observation 807c1731-f258-432a-ad80-5cf50c363cda · outbound

This paper cites Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis.

Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-16T01:03:47.009487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T01:03:47.009487Z digest=sha256:b9b2b60f61eef5a89bf835f23871c4ab83aea28a2f48b93abc515cb7310150fd

Pith citing papers

Observation 01acb22b-9897-4f5e-badd-c9a066afb2f6 · inbound

Towards Intelligent Legal Document Analysis: CNN-Driven Classification of Case Law Texts cites this paper.

Towards Intelligent Legal Document Analysis: CNN-Driven Classification of Case Law Texts Identifying Legal Holdings with LLMs: A Systematic Study of Performance, Scale, and Memorization

Reference 5

Resolution
verified exact
arxiv_id, observed 2026-05-10T05:56:10.840022Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-05-10T05:56:03.443358Z digest=sha256:6843c9164ddd3c256daf5e17bec239bea84b99adabfadf83519b975abaeada89