Paper Citation Record · LEDGER

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications

As of 11 August 2026, this Paper Citation Record lists 42 of 42 outbound references and 1 inbound Pith citation observation for arXiv:2601.22025.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2601.22025 v2

Coverage vector

measured 42 of 42 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-03T06:46:26.478418Z

measured 43 of 43 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T13:52:28.587806Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

42 of 42 outbound references displayed

verified exact0
verified fuzzy0
unresolved42
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0d4274b2-69b1-4e55-912c-3f70d875307e · outbound

This paper cites Constitutional AI: Harmlessness from AI Feedback.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Constitutional AI: Harmlessness from AI Feedback

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.181481Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6fec83e7-30de-4b38-b3b0-dcd8c80cd51f · outbound

This paper cites Ragas: Automated Evaluation of Retrieval Augmented Generation.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Ragas: Automated Evaluation of Retrieval Augmented Generation

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.193439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1d7edf6f-ede9-48e4-a462-222bdd539e28 · outbound

This paper cites Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.200818Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7d21660b-26a8-4905-baf1-ca082d8d8a86 · outbound

This paper cites Language model evaluation harness.https://github.com/EleutherAI/lm-evaluation-harness, 2023.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Language model evaluation harness.https://github.com/EleutherAI/lm-evaluation-harness, 2023

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.207610Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fa6ab860-6b49-4130-b8ec-0d2b137789e0 · outbound

This paper cites On calibration of modern neural networks.International Conference on Machine Learning, pages 1321–1330, 2017.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications On calibration of modern neural networks.International Conference on Machine Learning, pages 1321–1330, 2017

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.212907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d7fb54a3-5fe5-485c-b28a-39c729601e6e · outbound

This paper cites Measuring Massive Multitask Language Understanding.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Measuring Massive Multitask Language Understanding

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.218264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1b7beccb-dbfb-4fc2-913d-02deb0567a92 · outbound

This paper cites Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.230145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b5619446-54b0-4b95-b434-b9a6fe6be5bd · outbound

This paper cites Survey of hallucination in natural language generation.ACM Computing Surveys, 55(12):1–38, 2023.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Survey of hallucination in natural language generation.ACM Computing Surveys, 55(12):1–38, 2023

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.236101Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2f44361-f2f2-46ae-a306-e09af85d1fd0 · outbound

This paper cites Language Models (Mostly) Know What They Know.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Language Models (Mostly) Know What They Know

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.243906Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ec87f45a-0667-481b-ab1a-6f8785d22127 · outbound

This paper cites Computing krippendorff’s alpha-reliability.Departmental Papers (ASC), 2011.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Computing krippendorff’s alpha-reliability.Departmental Papers (ASC), 2011

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.252662Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dede9957-29c3-4500-81c8-dbb3fa3cf791 · outbound

This paper cites Retrieval- augmented generation for knowledge-intensive nlp tasks.Advances in Neural Information Processing Systems, 33:9459–9474, 2020.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Retrieval- augmented generation for knowledge-intensive nlp tasks.Advances in Neural Information Processing Systems, 33:9459–9474, 2020

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.259826Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 48a12c09-5ca5-4925-8609-f68c7a6a6754 · outbound

This paper cites Holistic evaluation of language models.Transactions on Machine Learning Research, 2023.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Holistic evaluation of language models.Transactions on Machine Learning Research, 2023

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.268546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 937a9e9b-e375-45a1-a24e-186803836d2c · outbound

This paper cites Rouge: A package for automatic evaluation of summaries.Text Summa- rization Branches Out, pages 74–81, 2004.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Rouge: A package for automatic evaluation of summaries.Text Summa- rization Branches Out, pages 74–81, 2004

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.278646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9c635d45-dfee-4172-8dd1-b51b48722f11 · outbound

This paper cites TruthfulQA: Measuring How Models Mimic Human Falsehoods.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications TruthfulQA: Measuring How Models Mimic Human Falsehoods

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.284150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b580fb96-f051-4051-9703-84073ec4ce2d · outbound

This paper cites On Faithfulness and Factuality in Abstractive Summarization.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications On Faithfulness and Factuality in Abstractive Summarization

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.291385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf6067e1-4326-4f96-939f-5a8c9c8cc09c · outbound

This paper cites FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.296715Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0fa099e0-a7b9-496c-b7ab-4e2fad7d3189 · outbound

This paper cites Openai evals.https://github.com/openai/evals, 2023.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Openai evals.https://github.com/openai/evals, 2023

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.305008Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cff1e5be-7173-4e4b-bd59-7f86a4ad03dd · outbound

This paper cites Training language mod- els to follow instructions with human feedback.Advances in Neural Information Processing Systems, 35:27730–27744, 2022.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Training language mod- els to follow instructions with human feedback.Advances in Neural Information Processing Systems, 35:27730–27744, 2022

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.313308Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e05ec9cd-5555-4d59-9cce-b93d2cab1d80 · outbound

This paper cites LLM Evaluators Recognize and Favor Their Own Generations.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications LLM Evaluators Recognize and Favor Their Own Generations

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.318507Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d0f27fb-637b-4b23-b91b-06d707a3b1a9 · outbound

This paper cites Red Teaming Language Models with Language Models.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Red Teaming Language Models with Language Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.324859Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0377750d-6f53-440b-9e31-f8b4592ec00d · outbound

This paper cites ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.331261Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6048266-81af-4ed5-9c79-d42da57ac594 · outbound

This paper cites NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.337035Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c8b1f316-d9e5-45ad-af54-0cc5541e8488 · outbound

This paper cites BLEURT: Learning Robust Metrics for Text Generation.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications BLEURT: Learning Robust Metrics for Text Generation

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.342276Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52b1f8f9-cd37-4b3d-9806-07d0c9eaf17f · outbound

This paper cites Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.348309Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 554301a6-be59-4a82-9304-0c40a860e416 · outbound

This paper cites Large Language Models are not Fair Evaluators.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Large Language Models are not Fair Evaluators

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.353366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3967a47a-f691-4b57-b57c-860e8a86fd68 · outbound

This paper cites BERTScore: Evaluating Text Generation with BERT.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications BERTScore: Evaluating Text Generation with BERT

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.361211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e028793b-e67c-49a0-aeb8-c55dc563c994 · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.366420Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0495afe7-d37d-4a4b-8fe3-b7e7c29526c7 · outbound

This paper cites PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.373904Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f69b204c-5028-4705-99bf-df87c86cbc5f · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.379891Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1ecf084-a41d-4aef-9793-e71613aa2689 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.391383Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 81b93a26-7363-47dd-b7a3-179827c81889 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.402681Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dedd61d1-4cff-465a-a81b-48a554abcda8 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.410237Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 333ea756-0285-427a-86d2-16c488817dd4 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.418141Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ad4d3492-84ed-4b7e-84c5-1e7563b2f7f0 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.425217Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 221e6b5e-ca51-41ce-8a36-f075d138d4e1 · outbound

This paper cites 38 A.5 LLM-as-Judge Checklist.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications 38 A.5 LLM-as-Judge Checklist

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.435130Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23232521-b3c1-489a-9270-047535cf5155 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.444650Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52f2671f-e169-4b06-9c3a-df1a8b0b211a · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.451123Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 27e39043-40f1-4236-acc4-0665905b6fe1 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.456928Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 585f1f71-b53e-4979-a2b2-ebd1bc7f65a5 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.463034Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38f0d459-79b2-49dc-badf-5834603dbe0a · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.467732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c9b374fc-ed31-415c-83aa-0682f972ba28 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.472653Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25d8ffb2-91e7-4a5b-81c7-56d5f0af33a3 · outbound

This paper cites an unresolved cited work.

When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications Unresolved cited work

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-03T06:46:26.478418Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 56e0dc3f-31bb-4b50-9c3b-b8108b784197 · inbound

Mi-Memory: A Lifecycle Memory Framework for Personal AI cites this paper.

Mi-Memory: A Lifecycle Memory Framework for Personal AI When Generic Prompt Improvements Hurt: Evaluation-Driven Iteration for LLM Applications

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-01T13:52:28.587806Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.