Paper Citation Record · LEDGER

Real Faults in Deep Learning Fault Benchmarks: How Real Are They?

As of 15 August 2026, this Paper Citation Record lists 32 of 32 outbound references and 1 inbound Pith citation observation for arXiv:2412.16336.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.16336 v1

Coverage vector

measured 32 of 32 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T10:44:40.781628Z

measured 33 of 33 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-18T05:43:41.140010Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-18T05:45:56.287131Z

Reference resolution

32 of 32 outbound references displayed

verified exact2
verified fuzzy24
unresolved6
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 358650a4-330f-4e21-818f-fdd7f161b4a6 · outbound

This paper cites Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Supporting controlled experimentation with testing techniques: An infrastructure and its potential impact,

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.485138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 139a5754-e372-42c1-8b6c-1124a4617b92 · outbound

This paper cites Defects4j: A database of existing faults to enable controlled testing studies for java programs,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Defects4j: A database of existing faults to enable controlled testing studies for java programs,

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-11T10:44:40.650785Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc749320-1015-43d6-9a82-8a788ad2ee06 · outbound

This paper cites Bugsjs: a benchmark of javascript bugs,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Bugsjs: a benchmark of javascript bugs,

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.462572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation edbe1646-17e3-41d3-8d3e-e9f09e9aed2d · outbound

This paper cites Deepfd: automated fault diagnosis and localization for deep learning programs,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Deepfd: automated fault diagnosis and localization for deep learning programs,

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-11T10:44:40.659759Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7b3e4835-253e-41f1-b19c-25caea606528 · outbound

This paper cites Automatic fault detection for deep learning programs using graph transformations,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Automatic fault detection for deep learning programs using graph transformations,

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.448648Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation ef98e235-27df-41dd-8414-5eb0632be028 · outbound

This paper cites Deepdiagnosis: automatically diagnosing faults and recommending actionable fixes in deep learning programs,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Deepdiagnosis: automatically diagnosing faults and recommending actionable fixes in deep learning programs,

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.434592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 27d5bf52-c449-424b-b07a-638057a5fd5e · outbound

This paper cites Bugs in machine learning-based systems: a faultload benchmark,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Bugs in machine learning-based systems: a faultload benchmark,

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.420711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation da230ca8-3605-4f5d-8126-2b6c0ef2bf6b · outbound

This paper cites gdefects4dl: a dataset of general real-world deep learning program defects,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? gdefects4dl: a dataset of general real-world deep learning program defects,

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.407002Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 1e536350-91f5-4e69-9fdd-cf0289c26de8 · outbound

This paper cites Iso/pas 21448:2019 road vehicles — safety of the intended functionality.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Iso/pas 21448:2019 road vehicles — safety of the intended functionality

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.388141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 432ade6d-2800-44d2-a59d-6eb565861912 · outbound

This paper cites Taxonomy of real faults in deep learning systems,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Taxonomy of real faults in deep learning systems,

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-11T10:44:40.687033Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 63b1ab55-d556-4a01-bd9a-9e37795888b6 · outbound

This paper cites Guidelines for snowballing in systematic literature studies and a replication in software engineering,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Guidelines for snowballing in systematic literature studies and a replication in software engineering,

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.373503Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c4975b0f-4912-41a4-a02d-0af41a70c9d8 · outbound

This paper cites Automatically repairing tensor shape faults in deep learning programs,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Automatically repairing tensor shape faults in deep learning programs,

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.358392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation e7ff60b1-0320-439f-8438-ff192754fe78 · outbound

This paper cites Tensfa: detecting and repairing tensor shape faults in deep learning systems,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Tensfa: detecting and repairing tensor shape faults in deep learning systems,

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.341524Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 2bf43d7a-c3ea-4fd3-a29e-dd67f796963d · outbound

This paper cites Repairing dnn architecture: Are we there yet?.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Repairing dnn architecture: Are we there yet?

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.326041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation f6eef3ec-7bb6-4cc0-b297-fd06c96adae5 · outbound

This paper cites Detecting numerical bugs in neural network architectures,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Detecting numerical bugs in neural network architectures,

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.311185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation da38ddf6-a99a-4824-aba6-c600eef5fd58 · outbound

This paper cites An empirical study on tensorflow program bugs,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? An empirical study on tensorflow program bugs,

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.296810Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4b9428df-49be-4f0d-82b9-6de72851a31d · outbound

This paper cites Tensorfuzz: Debugging neural networks with coverage- guided fuzzing,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Tensorfuzz: Debugging neural networks with coverage- guided fuzzing,

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.282473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 7f99879b-8a1f-4541-a3e8-1c3785d1bbc7 · outbound

This paper cites TensorFlow Model Garden,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? TensorFlow Model Garden,

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-11T10:44:40.721349Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e048a40e-dfb8-4f8a-b9c2-dcb99d1c841e · outbound

This paper cites Exposing numerical bugs in deep learning via gradient back-propagation,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Exposing numerical bugs in deep learning via gradient back-propagation,

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.257998Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a2eca00b-b600-49b9-9ebe-770942179f00 · outbound

This paper cites Reliability assurance for deep neural network architectures against numerical defects,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Reliability assurance for deep neural network architectures against numerical defects,

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.242885Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation f517f0f5-8648-41df-ab2c-02caff7e33f8 · outbound

This paper cites Detecting tensorflow program bugs in real-world industrial environment,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Detecting tensorflow program bugs in real-world industrial environment,

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.228534Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation b142afa7-c650-4595-b306-eeb0ea5367f6 · outbound

This paper cites Autotrainer: An automatic dnn training problem detection and repair system,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Autotrainer: An automatic dnn training problem detection and repair system,

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.214016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 632d9b15-79a9-463b-9f39-624e1fcc97b7 · outbound

This paper cites Cleanml: A study for evaluating the impact of data cleaning on ml classification tasks,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Cleanml: A study for evaluating the impact of data cleaning on ml classification tasks,

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.198004Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6a4ed1a4-da26-41eb-8f9a-00f1634cf7ad · outbound

This paper cites Deeplocalize: Fault localization for deep neural networks,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Deeplocalize: Fault localization for deep neural networks,

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.181717Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 7586bb20-893e-4108-8d2e-3e28523dbf6d · outbound

This paper cites Repairing deep neural networks: Fix patterns and challenges,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Repairing deep neural networks: Fix patterns and challenges,

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.167104Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 36c969e3-fc3b-4651-ad0f-3947eb9579c7 · outbound

This paper cites Deepcrime: mutation testing of deep learning systems based on real faults,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Deepcrime: mutation testing of deep learning systems based on real faults,

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.152198Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation fe3dbf03-4179-4c83-a1ae-ac66ad19485d · outbound

This paper cites Deepcrime: from real faults to mutation testing tool for deep learning,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Deepcrime: from real faults to mutation testing tool for deep learning,

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.138283Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 291dc2e5-d8cd-4ccf-ab84-ef29b2843d77 · outbound

This paper cites DeepMutation++: A Mutation Testing Framework for Deep Learning Systems,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? DeepMutation++: A Mutation Testing Framework for Deep Learning Systems,

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-11T10:44:40.763962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eb811f32-82b2-4bfd-8b29-f9733bebc8b7 · outbound

This paper cites Generalized linear models,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Generalized linear models,

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-11T10:44:40.768259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e9eb1e71-0a3a-4cef-9609-2c7984a12726 · outbound

This paper cites On effect size.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? On effect size

Reference 30

Resolution: verified exact; doi, observed 2026-08-11T10:44:40.817550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation b95cbd5d-f098-4f39-9599-a34fc551b2e1 · outbound

This paper cites Replication package,.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Replication package,

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T10:44:41.121368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 5e1623fe-56f9-4b98-9f6c-9fb251193fa9 · outbound

This paper cites Towards Enhancing the Reproducibility of Deep Learning Bugs: An Empirical Study.

Real Faults in Deep Learning Fault Benchmarks: How Real Are They? Towards Enhancing the Reproducibility of Deep Learning Bugs: An Empirical Study

Reference 32

Resolution: verified exact; local_arxiv, observed 2026-08-11T10:44:40.849276Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Pith citing papers

Observation bac534fa-23c0-4836-b2d0-9f7520f5e6cb · inbound

JunoBench: A Benchmark Dataset of Crashes in Python Machine Learning Jupyter Notebooks cites this paper.

JunoBench: A Benchmark Dataset of Crashes in Python Machine Learning Jupyter Notebooks Real Faults in Deep Learning Fault Benchmarks: How Real Are They?

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-05-18T05:45:56.288967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.