Paper Citation Record · LEDGER

Metamorphic Testing of Deep Code Models: A Systematic Literature Review

As of 9 August 2026, this Paper Citation Record lists 22 of 22 outbound references and 1 inbound Pith citation observation for arXiv:2507.22610.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.22610 v1

Coverage vector

measured 22 of 22 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T11:32:56.144315Z

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-20T09:36:15.468902Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-20T09:38:10.860680Z

Reference resolution

22 of 22 outbound references displayed

verified exact3
verified fuzzy5
unresolved9
parse uncertain0
malformed identifier0
metadata mismatch5

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 92ef9c21-51b1-4fac-a33d-da62b010b795 · outbound

This paper cites Examining zero-shot vulnerability repair with large language models.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Examining zero-shot vulnerability repair with large language models

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T11:32:58.516654Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 019a3141-7141-4224-8ff2-b1071511df04 · outbound

This paper cites Asleep at the keyboard? assessing the security of github copilot’s code contributions.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Asleep at the keyboard? assessing the security of github copilot’s code contributions

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T11:32:58.202156Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 09c36d97-a338-4027-973d-05376efd0e4d · outbound

This paper cites Search-based software test data generation: a survey.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Search-based software test data generation: a survey

Reference 5

Resolution: metadata mismatch; raw_fallback, observed 2026-08-06T11:32:57.550601Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation f5c03007-9d36-4d6f-b0c2-89d362084e1e · outbound

This paper cites 2000, pp.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review 2000, pp

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T11:32:58.046337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 9655d805-77f7-401b-bced-896e1faad6c9 · outbound

This paper cites CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:55.202636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d3d5fb64-82c2-4b4c-a547-46fc8eb78c44 · outbound

This paper cites Black-box testing of deep neural networks through test case diversity.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Black-box testing of deep neural networks through test case diversity

Reference 9

Resolution: verified exact; doi, observed 2026-08-06T11:32:56.440360Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation ceee0b19-6d9e-4a31-a8a1-b034fed9e1f4 · outbound

This paper cites A Closer Look into Transformer-Based Code Intelligence Through Code Transformation: Challenges and Opportunities.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review A Closer Look into Transformer-Based Code Intelligence Through Code Transformation: Challenges and Opportunities

Reference 10

Resolution: metadata mismatch; local_arxiv, observed 2026-08-06T11:32:56.982961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation d748b97d-c348-4c15-96ff-a137a53a7ec2 · outbound

This paper cites Code Di"erence Guided Adversarial Example Genera- tion for Deep Code Models.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Code Di"erence Guided Adversarial Example Genera- tion for Deep Code Models

Reference 11

Resolution: verified exact; raw_fallback, observed 2026-08-06T11:32:57.140948Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 911dc58b-c8c9-4547-88ef-2a198a3f1518 · outbound

This paper cites Exploiting Code Symmetries for Learning Program Semantics.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Exploiting Code Symmetries for Learning Program Semantics

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:55.533706Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1504c14-bd2b-4d24-9334-e9f47a1b1d8d · outbound

This paper cites CCTEST: Testing and Repairing Code Completion Systems.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review CCTEST: Testing and Repairing Code Completion Systems

Reference 13

Resolution: metadata mismatch; local_arxiv, observed 2026-08-06T11:32:56.293027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation a0c97e0d-d679-4ec0-8916-2fd43bd82d6e · outbound

This paper cites Black-box Adversarial Example Attack towards FCG Based Android Malware Detection under Incomplete Feature Information.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Black-box Adversarial Example Attack towards FCG Based Android Malware Detection under Incomplete Feature Information

Reference 15

Resolution: metadata mismatch; local_arxiv, observed 2026-08-06T11:32:56.829479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 3d46ba8c-438f-48f3-9a7a-1682ecf34679 · outbound

This paper cites Monte Carlo tree search: A review of recent modi!cations and applications.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Monte Carlo tree search: A review of recent modi!cations and applications

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:55.803813Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9f63cb9b-d426-438e-bfcb-0ce27603b630 · outbound

This paper cites Source code authorship attribution using long short-term memory based networks: 22nd European Symposium on Research in Computer Security, ESORICS 2017.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Source code authorship attribution using long short-term memory based networks: 22nd European Symposium on Research in Computer Security, ESORICS 2017

Reference 19

Resolution: metadata mismatch; raw_fallback, observed 2026-08-06T11:32:56.673003Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 1d503248-6587-4d43-91e3-104f597bd9b3 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:55.998362Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1333a122-5a8a-4c19-a2f0-c3ac4d805d4f · outbound

This paper cites What are we really testing in mutation testing for machine learning? a critical re$ection.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review What are we really testing in mutation testing for machine learning? a critical re$ection

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T11:32:57.874592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation c70a898b-4a3d-46f1-8b6c-b12a00a5ce65 · outbound

This paper cites Unified Pre-training for Program Understanding and Generation.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Unified Pre-training for Program Understanding and Generation

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:55.852475Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6efbf01-4bf5-4fd2-a09e-6e558c0f25b2 · outbound

This paper cites Diversevul: A new vulnerable source code dataset for deep learn- ing based vulnerability detection.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Diversevul: A new vulnerable source code dataset for deep learn- ing based vulnerability detection

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:54.931102Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1fab706d-69fc-4fac-a669-7db056806677 · outbound

This paper cites Analyzing the Past to Prepare for the Future: Writing a Literature Review.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Analyzing the Past to Prepare for the Future: Writing a Literature Review

Reference 79

Resolution: verified exact; raw_fallback, observed 2026-08-06T11:32:57.329494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 15e603ff-2f05-44e9-b89f-60287a50293b · outbound

This paper cites an unresolved cited work.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Unresolved cited work

Reference 111

Resolution: unresolved; raw_fallback, observed 2026-08-06T11:32:57.699406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation a4c06026-32fa-402a-acc1-0b9233093eec · outbound

This paper cites Learning to Represent Programs with Graphs.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Learning to Represent Programs with Graphs

Reference 279

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:55.155291Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e7ab7b4-893e-4149-b42a-72f6bf93db5c · outbound

This paper cites GPT-4 Technical Report.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review GPT-4 Technical Report

Reference 2018

Resolution: unresolved; no resolver link, observed 2026-08-06T11:32:55.277384Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 56a64280-d5c3-43c3-853b-66aaba0b6c17 · outbound

This paper cites Large language model for vulnerability detection: Emerging results and future directions.

Metamorphic Testing of Deep Code Models: A Systematic Literature Review Large language model for vulnerability detection: Emerging results and future directions

Reference 2025

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T11:32:58.361716Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Pith citing papers

Observation 3bc269a8-a330-4151-8142-6d65eaf273ca · inbound

Contextualized Code Pretraining for Code Generation cites this paper.

Contextualized Code Pretraining for Code Generation Metamorphic Testing of Deep Code Models: A Systematic Literature Review

Reference 2

Resolution: verified exact; arxiv_id, observed 2026-05-20T09:38:10.862854Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.