Paper Citation Record · LEDGER

Is Your Automated Software Engineer Trustworthy?

As of 16 August 2026, this Paper Citation Record lists 43 of 43 outbound references and 2 inbound Pith citation observations for arXiv:2506.17812.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.17812 v1

Coverage vector

measured 43 of 43 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T19:06:54.016067Z

measured 45 of 45 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T07:55:07.930578Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T16:56:06.388037Z

Reference resolution

43 of 43 outbound references displayed

verified exact0
verified fuzzy15
unresolved28
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a9903265-4595-4d26-8c23-6bffbb68d848 · outbound

This paper cites SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering.

Is Your Automated Software Engineer Trustworthy? SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.853584Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bd4fedad-2a6d-49c4-94d4-ae8ace5fcf6c · outbound

This paper cites OpenHands: An Open Platform for AI Software Developers as Generalist Agents.

Is Your Automated Software Engineer Trustworthy? OpenHands: An Open Platform for AI Software Developers as Generalist Agents

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.858042Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4808eda5-6be2-4d23-8eae-187bf7971e95 · outbound

This paper cites SpecRover: Code Intent Extraction via LLMs.

Is Your Automated Software Engineer Trustworthy? SpecRover: Code Intent Extraction via LLMs

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.861962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 89ce5fba-1f0f-4c4c-a4b2-0eb064c6aa2e · outbound

This paper cites SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents.

Is Your Automated Software Engineer Trustworthy? SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.865883Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 500a784e-1e6b-48c3-b99e-0d1141b11b65 · outbound

This paper cites SWE-bench: Can language models resolve real- world github issues?.

Is Your Automated Software Engineer Trustworthy? SWE-bench: Can language models resolve real- world github issues?

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.869376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1d6fc7d-7b3c-424f-8762-dd68bfe3eb9b · outbound

This paper cites SWT-bench: Testing and validating real-world bug-fixes with code agents,.

Is Your Automated Software Engineer Trustworthy? SWT-bench: Testing and validating real-world bug-fixes with code agents,

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.607218Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 08eee94e-28d6-4dae-9de1-ab334bfd0a0c · outbound

This paper cites Consistent estimators for learning to defer to an expert,.

Is Your Automated Software Engineer Trustworthy? Consistent estimators for learning to defer to an expert,

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.594379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation ee3e69d9-c4b6-4270-84fb-0b0af4b87c5b · outbound

This paper cites Improving the effectiveness of peer code review in identifying security defects,.

Is Your Automated Software Engineer Trustworthy? Improving the effectiveness of peer code review in identifying security defects,

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.582539Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation b4db32ca-c6f0-4439-bc2f-8919afd0e3ee · outbound

This paper cites A research agenda for assessing the economic impacts of code generation models,.

Is Your Automated Software Engineer Trustworthy? A research agenda for assessing the economic impacts of code generation models,

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.570755Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation afc4ccab-bc2e-4b6c-8e98-a1d11bf7ce64 · outbound

This paper cites Automated unit test improvement using large language models at meta,.

Is Your Automated Software Engineer Trustworthy? Automated unit test improvement using large language models at meta,

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.558928Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 0686264b-f067-4a98-99a0-b8eb4bc3c291 · outbound

This paper cites Examining the use and impact of an ai code assistant on developer productivity and experience in the enterprise,.

Is Your Automated Software Engineer Trustworthy? Examining the use and impact of an ai code assistant on developer productivity and experience in the enterprise,

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.547678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 7e74b3b0-5e0d-4f0f-9969-4d4449b7bb40 · outbound

This paper cites Exploring and evaluating hallucinations in llm-powered code generation,.

Is Your Automated Software Engineer Trustworthy? Exploring and evaluating hallucinations in llm-powered code generation,

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.899084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e777703-f0fa-4366-927a-781179d2436b · outbound

This paper cites Using ai-based coding assistants in practice: State of affairs, perceptions, and ways forward,.

Is Your Automated Software Engineer Trustworthy? Using ai-based coding assistants in practice: State of affairs, perceptions, and ways forward,

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.903559Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 04efba9b-69ef-4950-869e-e4c02ac6f5fc · outbound

This paper cites How we refactor, and how we know it,.

Is Your Automated Software Engineer Trustworthy? How we refactor, and how we know it,

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.529669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation e7f2d27f-470a-4bd7-8c5e-5e0f85d62f58 · outbound

This paper cites Make your tools sparkle with trust: The picse framework for trust in software tools,.

Is Your Automated Software Engineer Trustworthy? Make your tools sparkle with trust: The picse framework for trust in software tools,

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.911073Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4edb066e-e08d-4ceb-8cea-e0560497a9ec · outbound

This paper cites Selective Question Answering under Domain Shift.

Is Your Automated Software Engineer Trustworthy? Selective Question Answering under Domain Shift

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.914685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b5ef00b4-4731-4b2d-9519-82083aaf42e5 · outbound

This paper cites Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering.

Is Your Automated Software Engineer Trustworthy? Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.918860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d9849b8b-229d-44e7-86e2-9e0ce409a10c · outbound

This paper cites Learning to defer to multiple experts: Consistent surrogate losses, confidence calibration, and confor- mal ensembles,.

Is Your Automated Software Engineer Trustworthy? Learning to defer to multiple experts: Consistent surrogate losses, confidence calibration, and confor- mal ensembles,

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.510636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 97a1360c-f1d1-4c23-9d6d-b35831d8c77c · outbound

This paper cites Introducing SWE-bench Verified — openai.com,.

Is Your Automated Software Engineer Trustworthy? Introducing SWE-bench Verified — openai.com,

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.498620Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation f1046443-89e2-4034-a8dd-f8bd353d0794 · outbound

This paper cites an unresolved cited work.

Is Your Automated Software Engineer Trustworthy? Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-15T19:06:54.486166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation c45f9067-0b6f-418b-a140-80a097456b3a · outbound

This paper cites an unresolved cited work.

Is Your Automated Software Engineer Trustworthy? Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-15T19:06:54.473905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 761b4ec1-206f-4cde-8bb9-d4d9507e6dd5 · outbound

This paper cites an unresolved cited work.

Is Your Automated Software Engineer Trustworthy? Unresolved cited work

Reference 22

Resolution: unresolved; raw_fallback, observed 2026-08-15T19:06:54.461489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation ae6beaaf-a2c0-4865-a7f5-4595208519ce · outbound

This paper cites Qwen3 Technical Report.

Is Your Automated Software Engineer Trustworthy? Qwen3 Technical Report

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.939040Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 35ade698-cf9d-428e-91c1-19fed3737c66 · outbound

This paper cites Gemma 3 Technical Report.

Is Your Automated Software Engineer Trustworthy? Gemma 3 Technical Report

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.942804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 732696ec-e653-48f9-9402-39ccf05308cd · outbound

This paper cites A Survey on LLM-as-a-Judge.

Is Your Automated Software Engineer Trustworthy? A Survey on LLM-as-a-Judge

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.946933Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bb5111af-b17c-434e-91e3-fbccb10ef573 · outbound

This paper cites Defects4j: A database of existing faults to enable controlled testing studies for java programs,.

Is Your Automated Software Engineer Trustworthy? Defects4j: A database of existing faults to enable controlled testing studies for java programs,

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.950532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d8f263ba-8aa1-44ba-87e7-355b4dca7c8a · outbound

This paper cites SWE-bench multimodal: Do ai systems generalize to visual software domains?.

Is Your Automated Software Engineer Trustworthy? SWE-bench multimodal: Do ai systems generalize to visual software domains?

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.443679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 80be686b-152a-4b76-baf1-cb700d152201 · outbound

This paper cites SWE-bench-java: A GitHub Issue Resolving Benchmark for Java.

Is Your Automated Software Engineer Trustworthy? SWE-bench-java: A GitHub Issue Resolving Benchmark for Java

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.958816Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 26ec7a09-b370-48f0-9712-4585db4ae93d · outbound

This paper cites SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?.

Is Your Automated Software Engineer Trustworthy? SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.963607Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 65d7bfb8-9ffc-4218-bee1-ba0d88287a9e · outbound

This paper cites Baxbench: Can llms generate correct and secure backends?.

Is Your Automated Software Engineer Trustworthy? Baxbench: Can llms generate correct and secure backends?

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.431641Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 8005e5d8-846e-4146-87f4-5f752fcd5343 · outbound

This paper cites Sota on swe-bench verified with inference- time scaling and critic model,.

Is Your Automated Software Engineer Trustworthy? Sota on swe-bench verified with inference- time scaling and critic model,

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.419762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 0e867368-149a-47d2-9a15-459a422edf77 · outbound

This paper cites Judging llm-as-a-judge with mt-bench and chatbot arena,.

Is Your Automated Software Engineer Trustworthy? Judging llm-as-a-judge with mt-bench and chatbot arena,

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.974730Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c59a42ba-7e1d-4028-9e5f-267ad9b6eeb7 · outbound

This paper cites CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?.

Is Your Automated Software Engineer Trustworthy? CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.978307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a8afda6-4632-407b-903f-15d93c9bbcae · outbound

This paper cites Agent-as-a-Judge: Evaluate Agents with Agents.

Is Your Automated Software Engineer Trustworthy? Agent-as-a-Judge: Evaluate Agents with Agents

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.982097Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 553b85ed-af1e-43da-9507-02cb6c51e54d · outbound

This paper cites What makes a good bug report?.

Is Your Automated Software Engineer Trustworthy? What makes a good bug report?

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:53.986237Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bcb059a8-86fb-40d1-a1ce-7116c8c36373 · outbound

This paper cites Deep learning based valid bug reports determination and explanation,.

Is Your Automated Software Engineer Trustworthy? Deep learning based valid bug reports determination and explanation,

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.393128Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 18e388f6-ce07-49dd-a96d-ccd99aa85f44 · outbound

This paper cites Chaff from the wheat: Characterizing and determining valid bug reports,.

Is Your Automated Software Engineer Trustworthy? Chaff from the wheat: Characterizing and determining valid bug reports,

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.380570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 070d0d2b-1fa0-42ee-bf5f-5056aeb2478e · outbound

This paper cites Industrial adoption of machine learning techniques for early identification of invalid bug reports,.

Is Your Automated Software Engineer Trustworthy? Industrial adoption of machine learning techniques for early identification of invalid bug reports,

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T19:06:54.366737Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 1fb45e88-6be7-486c-8332-e0640b553c5a · outbound

This paper cites Can We Enhance Bug Report Quality Using LLMs?: An Empirical Study of LLM-Based Bug Report Generation.

Is Your Automated Software Engineer Trustworthy? Can We Enhance Bug Report Quality Using LLMs?: An Empirical Study of LLM-Based Bug Report Generation

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:54.001685Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 402b9ae6-5d2c-4f12-a469-400d33b8dc65 · outbound

This paper cites Chatbr: Automated assessment and improvement of bug report quality using chatgpt,.

Is Your Automated Software Engineer Trustworthy? Chatbr: Automated assessment and improvement of bug report quality using chatgpt,

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:54.005848Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e331e298-0b84-4e69-9e23-323fa5203d50 · outbound

This paper cites Agentless: Demystifying LLM-based Software Engineering Agents.

Is Your Automated Software Engineer Trustworthy? Agentless: Demystifying LLM-based Software Engineering Agents

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:54.009407Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 59237eb5-3143-4594-9605-5117d28c2196 · outbound

This paper cites LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks.

Is Your Automated Software Engineer Trustworthy? LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:54.012470Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6cc4d8fe-ec39-4ae2-bc22-b59a1a2ea31a · outbound

This paper cites Are Large Language Models Memorizing Bug Benchmarks?.

Is Your Automated Software Engineer Trustworthy? Are Large Language Models Memorizing Bug Benchmarks?

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-15T19:06:54.016067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation a748925b-c915-4368-9fe8-1544e483d457 · inbound

Don't Start What You Can't Finish: A Counterfactual Audit of Support-State Triage in LLM Agents cites this paper.

Don't Start What You Can't Finish: A Counterfactual Audit of Support-State Triage in LLM Agents Is Your Automated Software Engineer Trustworthy?

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-05-10T07:57:15.522032Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation 4049b2e9-ad58-4d8b-bf89-cb06c432cde7 · inbound

The Partial Testimony of Logs: Evaluation of Language Model Generation under Confounded Model Choice cites this paper.

The Partial Testimony of Logs: Evaluation of Language Model Generation under Confounded Model Choice Is Your Automated Software Engineer Trustworthy?

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-11T16:56:06.390545Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.