Pith. sign in

Paper Citation Record · LEDGER

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries

As of 10 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 1 inbound Pith citation observation for arXiv:2502.02794.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.02794 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T11:10:43.610161Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T13:57:58.048943Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T13:58:04.938613Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact1
  • verified fuzzy14
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a95d44f5-7178-4de5-9c9c-96599c7dbef3 · outbound

This paper cites Which documentation for software maintenance?.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Which documentation for software maintenance?

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.181730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.464614Z digest=sha256:7c5bcb904a3698c0dfc6c09756a4d3e952aa8b5d750c6d4ae2e32152a35d9340

Observation c5d631a4-1463-4383-aae8-6e075027861f · outbound

This paper cites Examining the evolution of code comments in postgresql,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Examining the evolution of code comments in postgresql,

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.470009Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.470009Z digest=sha256:8efcf46d673a1d6bfec948c229441c50958c7f02bc1c636be941e8bab86fcca7

Observation aee5ead3-7451-4ebc-944c-b240d0aa0f7c · outbound

This paper cites /* icomment: Bugs or bad comments?*,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries /* icomment: Bugs or bad comments?*,

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.475145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.475145Z digest=sha256:b7e43adecf13197d7159b50983065b2a3a6cee48acbcdd197ae40b6b5f34d4a2

Observation f236a152-ca53-4458-9316-725fd3f902a2 · outbound

This paper cites acomment: mining annotations from comments and code to detect interrupt related concurrency bugs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries acomment: mining annotations from comments and code to detect interrupt related concurrency bugs,

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.153152Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.481096Z digest=sha256:93777805e2013fa630ebad96d376d10ab8c76fe0aa331fa340bc152d627bcc9c

Observation 1b34e786-8ad9-4264-9017-4b0fa48211b0 · outbound

This paper cites @ tcomment: Testing javadoc comments to detect comment-code inconsistencies,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries @ tcomment: Testing javadoc comments to detect comment-code inconsistencies,

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.134640Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.486735Z digest=sha256:fe162c81be1a9390659a689f8ce32501cad9c062c4366869b538cd511a1a5f10

Observation 3c68c659-a07b-4080-a1f4-637c176c01d8 · outbound

This paper cites Detecting fragile comments,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Detecting fragile comments,

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.118940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.493238Z digest=sha256:55cffb9069e1f8ed2ab8b8e6509234cc7aef75f4a391ae6864514f2d91280f06

Observation a2fdc91c-7305-4cb2-a5e8-00e8b7c3e43f · outbound

This paper cites Coherence of comments and method implementations: a dataset and an empirical investigation,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Coherence of comments and method implementations: a dataset and an empirical investigation,

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.081704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.498666Z digest=sha256:8ed86771b4bf5e49d4276722bfc5679caecdde25a05bb5235262d5a811f72ad4

Observation d5481132-68db-4439-969e-287ebd414462 · outbound

This paper cites Deep just- in-time inconsistency detection between comments and source code,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Deep just- in-time inconsistency detection between comments and source code,

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.046616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.503694Z digest=sha256:7b923ad011c74a5248986173dbfdb8fcc1c2a27463e9d1e7d95e1a4ce11059e6

Observation da1e3060-4a36-4cc6-a117-eb5304e31e96 · outbound

This paper cites Detecting code comment inconsistency using siamese recurrent network,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Detecting code comment inconsistency using siamese recurrent network,

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:14.027616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.508503Z digest=sha256:3f34ba7dd88d0f2ca2b53962a80b71eff49a0dc52c5af8eee0260369a3d5ae5a

Observation 059ce772-6a50-4829-95ad-282c8d2f4760 · outbound

This paper cites Competition- level code generation with alphacode,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Competition- level code generation with alphacode,

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.513244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.513244Z digest=sha256:4f31cc0ce54c6016788d23dad4ddd24356cbfb02192b74b2b809bd8513894423

Observation 1a44dc72-3397-44ab-b4a6-74a0b62a93f9 · outbound

This paper cites Large language models are few- shot testers: Exploring llm-based general bug reproduction,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Large language models are few- shot testers: Exploring llm-based general bug reproduction,

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.998615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.517937Z digest=sha256:0b5db50671beb42bd71a9265fe8f7719b07c481521add3ec2bea3f46de13edca

Observation 435cf357-062f-443c-9ee5-664664da2f05 · outbound

This paper cites Adaptive test generation using a large language model,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Adaptive test generation using a large language model,

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.982546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.522577Z digest=sha256:b158f856915a06af5543a9b644c38be79b8c907b3faafe998fab9fbe9d7bd1e8

Observation 79fb9caf-1921-44d4-b202-ce05d4d5b320 · outbound

This paper cites Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs

Reference 13

Resolution
verified exact
local_arxiv, observed 2026-08-09T11:10:58.800061Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.527434Z digest=sha256:ef7e1b7c4038015b91b8f1a9ed8419aae601580dff04f1cd0e12828ba6de513f

Observation 55d3102d-a38d-40cf-8a95-09f1bd0f9b61 · outbound

This paper cites A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.532852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.532852Z digest=sha256:0e114297429a20017d0540a0676fcae144322f470233c38e09d803b40c815344

Observation 81cd43c4-0b04-4249-9825-3b4d5115912d · outbound

This paper cites Evosuite: automatic test suite generation for object-oriented software,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Evosuite: automatic test suite generation for object-oriented software,

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.537774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.537774Z digest=sha256:87d27120083c9ae754104e9aeebb5ff71bb96a5cb35e1ebab99b79fe5ce65e07

Observation 39318f00-ba44-4e13-b0b8-2aca65c3c5f7 · outbound

This paper cites Chain-of-thought prompting elicits reasoning in large language models,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Chain-of-thought prompting elicits reasoning in large language models,

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.541890Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.541890Z digest=sha256:4a08a5aaf0b2ab25e057ab1f7202c764c9e9d85b99dc2db478c8e9976cccb999

Observation 43cdf743-7104-410b-93e1-019d6b08761f · outbound

This paper cites Self-Consistency Improves Chain of Thought Reasoning in Language Models.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Self-Consistency Improves Chain of Thought Reasoning in Language Models

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.545907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.545907Z digest=sha256:1d96b15ff92397711e53238822b724be8481d99187b19f402836528832400c04

Observation 3adf1e15-1e64-48c7-ba65-1877d6aa8e64 · outbound

This paper cites Defects4j: A database of existing faults to enable controlled testing studies for java programs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Defects4j: A database of existing faults to enable controlled testing studies for java programs,

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.550426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.550426Z digest=sha256:809a82cb3d8588cc0666f66d312cdf658cbcfd186e460e36ecafc2735ab87ccf

Observation 1013b392-e1e4-4f85-a6f0-eba24472ffcb · outbound

This paper cites Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.554435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.554435Z digest=sha256:a11a965a4e1e5adf0692d8fd20f12790436cf9d19cbf525f58e9d65ec5117562

Observation 606245b2-7cc3-46ba-aa4e-08686a6a01af · outbound

This paper cites Automatic Code Summarization via ChatGPT: How Far Are We?.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Automatic Code Summarization via ChatGPT: How Far Are We?

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.559168Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.559168Z digest=sha256:1e2700783c1e0cd7f301e170c8beb8b88e414c2a385173b811467a476706c2c3

Observation 70a7b020-4105-4003-82ee-7acabd93fedd · outbound

This paper cites Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization).

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Automatic Semantic Augmentation of Language Model Prompts (for Code Summarization)

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.564400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.564400Z digest=sha256:08abc918bb20f3ddee26f3dce6dc4359eba82ffa432d5c06cc1acc236c930ab3

Observation ffb2425c-2516-4357-b0f2-8a63ae6cb195 · outbound

This paper cites GPT-4 Technical Report.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries GPT-4 Technical Report

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.569635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.569635Z digest=sha256:ffc88dbb0f864e213d805b346c8876bb52a631d3c999f0c05961755797386cb1

Observation d0a217aa-5fd0-4739-95da-c5c2a7e5aa3d · outbound

This paper cites A survey on metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries A survey on metamorphic testing,

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.574801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.574801Z digest=sha256:3a6d3660ba8a9d09b7d2846c09f3eede876f8eafed3bbc3369207f6c334b569f

Observation 3738edaf-d2f8-426e-acc5-d1382d3390f4 · outbound

This paper cites Assessing robust- ness of ml-based program analysis tools using metamorphic program transformations,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Assessing robust- ness of ml-based program analysis tools using metamorphic program transformations,

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.934388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.580910Z digest=sha256:7b594b1afb3cd3e1be9cdbed88bcf6ace1e5f87a5c6a1ea9358898baab75d9bd

Observation 5a1da619-48b1-47dc-a9a5-e1b2adf31d5b · outbound

This paper cites Properties of machine learning applications for use in metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Properties of machine learning applications for use in metamorphic testing,

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.919341Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.587091Z digest=sha256:0f5e39037426cfde05833d04e1a062de69285e5fc001e60b7b415cad8be24f0d

Observation cc21ea90-f070-4b5b-bfa9-a58bb64c91f2 · outbound

This paper cites Testing and validating machine learning classifiers by metamorphic testing,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Testing and validating machine learning classifiers by metamorphic testing,

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.904406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.593140Z digest=sha256:a8b93b553e06dc079fca9d10b4e7dc969486360a809373999d0ea69100814f3c

Observation 7826cce9-19bd-466b-92a5-115f6577d361 · outbound

This paper cites On Testing Non-Testable Programs,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries On Testing Non-Testable Programs,

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.888093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.598999Z digest=sha256:827aa211cf4f401ec70fb8bc767f9f56f2ca637d0db4c529f6585419a92105e5

Observation f4c252ee-2ffe-4135-93cf-ccc0462356a7 · outbound

This paper cites Chain-of-thought prompting elicits reasoning in large language models,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Chain-of-thought prompting elicits reasoning in large language models,

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-09T11:10:43.604514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-09T11:10:43.604514Z digest=sha256:4af34d3737b0eaf10565378d80be7bb7fca7610c32e6bcf55ed958ae3b343617

Observation c38f9cd1-b8f7-4363-b24a-f8620f2cdfea · outbound

This paper cites Major: An efficient and extensible tool for mutation analysis in a java compiler,.

METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries Major: An efficient and extensible tool for mutation analysis in a java compiler,

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-09T11:11:13.860398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-09T11:10:43.610161Z digest=sha256:ff8989e01bbb1cf11e13aabc5e1421c0bea725eb646ef1b2c965d48b845c8d13

Pith citing papers

Observation 21730c79-ffe6-4b9d-b0e2-0bd0c2514b4f · inbound

We Must Have Missed This Comment: Detecting and Repairing Stale Function References in Linux Kernel Comments cites this paper.

We Must Have Missed This Comment: Detecting and Repairing Stale Function References in Linux Kernel Comments METAMON: Finding Inconsistencies between Program Documentation and Behavior using Metamorphic LLM Queries

Reference 11

Resolution
verified exact
local_arxiv, observed 2026-08-05T13:58:05.029561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-05T13:57:58.048943Z digest=sha256:fb2e1b7a624278945915dedbdd2b4d5492732a756345c02d5bb4281972586859