Pith. sign in

Paper Citation Record · LEDGER

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution

As of 7 August 2026, this Paper Citation Record lists 46 of 46 outbound references and 0 inbound Pith citation observations for arXiv:2604.05955.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.05955 v1

Coverage vector

measured 46 of 46 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-10T18:45:06.682021Z

measured 46 of 46 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

46 of 46 outbound references displayed

  • verified exact23
  • verified fuzzy8
  • unresolved11
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation ccf9680d-e76d-49fb-ac58-f59357d48986 · outbound

This paper cites ISO/IEC/IEEE International Standard - Systems and software engineering – Life cycle processes –Requirements engineering.ISO/IEC/IEEE 29148:2011(E) (2011), 1–94.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution ISO/IEC/IEEE International Standard - Systems and software engineering – Life cycle processes –Requirements engineering.ISO/IEC/IEEE 29148:2011(E) (2011), 1–94

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-05-10T18:45:43.508981Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:ce81fd82fb555161a0797adddcb333541c8ee4b6ac076dc1feb75fe41e1035ee

Observation 347c982b-56af-4d0b-bb2d-f59a96d63ed0 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:51:06.260997Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:fa203d0261a91e63119ea78322dff5d89da204fbeba2619546ae4b4adc182cb5

Observation 45013639-5467-4fce-a245-95383c78faf5 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:51:06.502230Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:4ee801bdbbb33ea78acceffa243e359ea009efbc86ac98af2ff9f8c511b6f7bc

Observation a5e47dc2-c021-40db-aded-c3635a193cdb · outbound

This paper cites MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-05-10T18:45:43.535505Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:5c1d24f4770fa8d526f575554987d4ea76a3de49832ff2882180fb09805ec50f

Observation 9aa58f7b-33a7-4c5a-864b-c9d12c26bc41 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Evaluating Large Language Models Trained on Code

Reference 5

Resolution
verified exact
local_arxiv, observed 2026-05-11T00:00:54.118942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:128c329d792de6b26b806dc91115d8b4fad78755a157b1b06cbd53e03e5a770c

Observation fd6a62a3-84c5-4c40-ae2a-9983950937e1 · outbound

This paper cites Hierarchical Clustering: Objective Functions and Algorithms.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Hierarchical Clustering: Objective Functions and Algorithms

Reference 6

Resolution
verified exact
doi, observed 2026-05-10T18:45:43.531230Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:2a16e183a164f2de010ec5082f83ced098e01da6ba9646d76e8a5f266dd17f40

Observation eb20c738-4261-441e-8fab-20a255f91552 · outbound

This paper cites 1999.Mathematical methods of statistics.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution 1999.Mathematical methods of statistics

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:51:06.499487Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:a4e4d7b6629b63c8f7188bae8bc5c7e3adc160481aee0ece58acb0ad4bad4cf0

Observation 58ff9215-614e-4895-9c28-56911a4cc6cf · outbound

This paper cites SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?

Reference 8

Resolution
verified exact
arxiv_id, observed 2026-05-12T13:48:53.849224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:a7c3ff90a201c91aa3de25791b0deb3b9b047ebb63e04d4be45122f20e5806de

Observation ecf4f623-225c-4ab6-b4d4-30126484c951 · outbound

This paper cites Automatic code documentation generation using gpt-3.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Automatic code documentation generation using gpt-3

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-05-10T18:45:43.539792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:e1baa40ff0432571922758ca769bfc47f0fd915e516d07045270c9df1212b7f7

Observation 2040ff65-f9e6-49a9-b36f-6565790f8e9b · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 10

Resolution
verified exact
doi, observed 2026-05-10T18:45:43.527903Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:2d7d986649002cfb4b06f330f98fbcbad069ced74946604c13b738f886c8d196

Observation 601a3286-47cd-46b9-9498-f2824e3d4f62 · outbound

This paper cites Octobench: Benchmarking scaffold-aware instruction following in repository-grounded agentic coding.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Octobench: Benchmarking scaffold-aware instruction following in repository-grounded agentic coding

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-11T00:00:53.989252Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:44f8ddc262962da4e6e49ee79b931d78cfadac8b7750643e1f76005c595e68db

Observation cb87ef9a-6397-45da-9812-3751d26edf23 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:53:04.231080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:2735d361b5e2d592e039ab9ccb120269125d7699cf2665185fe38cb211254d80

Observation 7c63a06f-a3d3-4a9d-99af-70e594abd194 · outbound

This paper cites A Survey on Code Generation with LLM-based Agents.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution A Survey on Code Generation with LLM-based Agents

Reference 13

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T23:02:21.366092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:16f05cc3a667d341ea071bf8f562a44d4a5492c11e27b3011a3b272e79580d30

Observation e343d9e8-c06c-416a-a438-0e1ec81cd703 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:53:04.229141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:d08d06a33ea27e8567e6336b5e11fbf8abf384985b8d3fb856044cd3939839b1

Observation e34fa924-4bf7-44da-99da-99d3c842853a · outbound

This paper cites Gruber, Catherine Baudin, John H.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Gruber, Catherine Baudin, John H

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:51:06.496528Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:90c53059616864d6968eeb3f2740b7ef4ccfbbb871a18e1dc5d2ce47c9492622

Observation df605163-c139-41a3-a874-2cff929177f4 · outbound

This paper cites SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories?.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories?

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-07-02T02:17:13.298963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:2e909371a99dca7932a5bcb560cd8efc8f0b80dfb7dd97febd2cb57a6740e302

Observation 640252dd-b743-45ff-b075-24f3e2e78966 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 17

Resolution
verified exact
doi, observed 2026-05-10T18:45:43.542718Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:e5fd3fc739dc211dda507c3e451a3b53f047ed2806ba0de66227bc327d854e3b

Observation 995cecd6-df53-4155-856b-5021c654281f · outbound

This paper cites A Survey on Large Language Models for Code Generation.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution A Survey on Large Language Models for Code Generation

Reference 18

Resolution
verified exact
arxiv_id, observed 2026-05-13T20:18:07.016071Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:48d9e7cf3cfce57a37427504a5a93f6fbe65c578a5c38377e966ab40a80e485a

Observation 05f81524-c7bb-4936-b2bf-0162369f0098 · outbound

This paper cites Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:53:04.227219Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:28e568e35905ca251f462e7b020edc0ec976a95fd474a0aea59821bc27217690

Observation ff37fc14-6534-4369-8a28-e96326ffd3cf · outbound

This paper cites Jimenez, Ofir Press, and John Yang.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Jimenez, Ofir Press, and John Yang

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:53:04.224683Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:bfadb6a2fce147c8caa69d71853659ca6079140ee8716516888182f318da1e6d

Observation e2aceb9f-3943-4a96-89b3-73e6ebb55ab2 · outbound

This paper cites doi:10.48550/arXiv.2601.08806 , url =.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution doi:10.48550/arXiv.2601.08806 , url =

Reference 21

Resolution
verified exact
arxiv_id, observed 2026-05-11T00:00:53.964501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:982ac4c5502ed36c59696656e9c645a77f420802a94442d376e61c1c98527ce2

Observation f3c23c10-6d61-49f1-a6ec-b36b95daa247 · outbound

This paper cites Available: https://arxiv.org/abs/2601.11655.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Available: https://arxiv.org/abs/2601.11655

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-11T00:00:54.100359Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:b0ca4d91cf43932977543813c8fa9237c0dad5e31a1779ea518c6348c510e6c8

Observation 53090f60-aaa8-494d-96a7-4b8e7576b8b7 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:51:06.492907Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:d05caf3577e12e48e4788bcb847e718f18ebe2de4593ac7703defea3f8f2bffd

Observation feb0fe61-6bc0-4921-98bb-18c55dbf5262 · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-05-15T11:40:02.914862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:2b443d9d0086800e12b5b1bc48172c946189a371662f761f2eec3625d02f8e54

Observation 081ba171-af22-496d-bce9-2ed3bd4bc7a4 · outbound

This paper cites 2025.doi: 10.48550/arXiv.2511.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution 2025.doi: 10.48550/arXiv.2511

Reference 25

Resolution
verified exact
doi, observed 2026-05-10T18:45:43.499682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:ed60302e691fc8755b853419742a839a089526f866387985c5780e1f3b877f08

Observation 96ab812f-17fa-4235-ab62-8176449531f1 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:53:04.219550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:8f2a7fdb0d6ee92f822838068e1b7018454a6b627a93dd93fc9ecf72fed4986c

Observation 5485bc60-c308-4219-8143-5d058983cc72 · outbound

This paper cites InForty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution InForty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:53:04.235883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:9d0a4d28758a04e0f09a4af82c6f0fb19190b5ec017da25b3fccdddee9daf407

Observation 63dba7c5-5539-45f0-a825-7d394c152420 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:53:04.222471Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:89a60577a009db675d0be9c31da3fbcb5e81d72e8e50fd2281d6a70a7d7fa582

Observation 41f1ff5b-3f22-46fb-a1dd-bf4d675216b4 · outbound

This paper cites Sentence- BERT : Sentence Embeddings using S iamese BERT -Networks.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Sentence- BERT : Sentence Embeddings using S iamese BERT -Networks

Reference 29

Resolution
verified exact
doi, observed 2026-05-10T18:45:43.512492Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:88030ca5f594cd0631855b785470002af6b7c1005dbd75053a0a5cec648a34e2

Observation 17a6799e-8ecd-4c19-8b81-07fb4b85d698 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:53:04.242542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:064327cee46c0e1b34a9a84ed1ad13ebee14d846e3bd8afecfa5eed58dd5315d

Observation eb98c3be-78e5-436c-9238-dd853074ce25 · outbound

This paper cites Traceability transformed: Generating more accurate links with pre-trained BERT models.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Traceability transformed: Generating more accurate links with pre-trained BERT models

Reference 31

Resolution
metadata mismatch
arxiv_id, observed 2026-05-10T18:45:43.495737Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:3a0bc6645b3503b3e2d6bb1fd906f5d2cae9c3b824ab34bdd3f3548c770f9349

Observation 49c3a1ed-209a-4156-bf2f-05ba1950cd5f · outbound

This paper cites Nguyen and Raymond Choo.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Nguyen and Raymond Choo

Reference 32

Resolution
metadata mismatch
arxiv_id, observed 2026-05-10T18:45:43.516892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:067502397f253d2fecf814e7511738df2b43efff28f8b1ab2934f6ad90473948

Observation 40c74ed0-2ffb-4b2f-b193-3e974d4fdef8 · outbound

This paper cites 2025.Introducing Sonar Foundation Agent.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution 2025.Introducing Sonar Foundation Agent

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:51:06.264890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:669f4a3127b0e14170f819cc40124cd02684c16c5d4d1d0e430a27e686b0e607

Observation aa93041c-4453-4732-a8fb-0e35fb9b9b76 · outbound

This paper cites Source Code Summarization in the Era of Large Language Models.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Source Code Summarization in the Era of Large Language Models

Reference 34

Resolution
verified exact
arxiv_id, observed 2026-05-11T00:00:53.974105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:65a0458b5173fdb242e86f27ebbde43b63c4d38d0e3659aa357e882dd1b70c82

Observation bc508bc7-c671-48d3-95cf-0bb2189a34d6 · outbound

This paper cites Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks

Reference 35

Resolution
verified exact
arxiv_id, observed 2026-05-10T18:45:43.473724Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:f499fdbf0d45f770b3c13808035f0ddf4be1699c8349ee93d3913aff41ded8f9

Observation 862581a3-dbf8-44dd-a9d1-d9f4e3cf9ff0 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:53:04.233605Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:e9e33f62cbd54eafbf1de33706b177b0b3259f0140b65a24f4224bdc098fcc62

Observation 283c4fcb-f6f9-4780-91b4-b2ae80890710 · outbound

This paper cites arXiv: 2511.13646 [cs.SE].URL:https://arxiv.org/abs/2511.13646.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution arXiv: 2511.13646 [cs.SE].URL:https://arxiv.org/abs/2511.13646

Reference 37

Resolution
verified exact
arxiv_id, observed 2026-05-10T18:45:43.490726Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:a449ab4e8984455f335f54ecf9124511f93ad9ff1377ac74d588ba9a637566de

Observation 00ad4ebb-bd21-41f5-a523-66723c45ec9f · outbound

This paper cites Swe-compass: Towards unified evaluation of agentic coding abilities for large language models.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Swe-compass: Towards unified evaluation of agentic coding abilities for large language models

Reference 38

Resolution
malformed identifier
arxiv_id, observed 2026-05-11T00:00:54.051487Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:fb821ce41e9d3ca3b5e01d2d4852e4de4d568970ffe5d6fc0b342efbbcb57069

Observation e1c2ec55-2755-4c87-b407-642d49241dd7 · outbound

This paper cites Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:53:04.238537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:5f8fdc5de5fccf2b85979baf9aa95be1ce6cbb6bac41a8a24692526a362a24d8

Observation df7dd96f-ce15-4814-811f-a901b84b8ef7 · outbound

This paper cites Jimenez, Alex L.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Jimenez, Alex L

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T15:53:04.240491Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:dcb4f4004bbba82ead402880e77f65c2afe5242de5f72c0cb6c675d7d74536b3

Observation 94946851-9ce1-4143-bd0b-06b6fc4fb32a · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 41

Resolution
verified exact
arxiv_id, observed 2026-05-10T18:45:43.478585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:e9043723f398f06f2c7a585d6dd03919959c281f6724af633d68156b7ff232c9

Observation d7516e77-9d4b-4617-b47b-7218a22e6a20 · outbound

This paper cites Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge

Reference 42

Resolution
verified exact
arxiv_id, observed 2026-05-15T20:00:24.757706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:fbfe4c7304799ee76f8898c61ebc6bb7ac4a5255ce4c702a2f2e6bf902948557

Observation 1a533866-5b08-46eb-b539-5d91ba0da30a · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:53:04.217233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:0d923df7b8894be3afc3aef9951154eff43169673e33422b0a279568e43da9bb

Observation db835cb8-a2e5-43ba-a7d6-5aaddf84f6c7 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 45

Resolution
verified exact
doi, observed 2026-05-10T18:45:43.486305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:92913b11b21c3cc6a54fdf4852c7db160035a21e4b1117bd784edb8aef805fb0

Observation 69dc3dd2-39b9-4005-a7b6-76a03f544d35 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 46

Resolution
verified exact
arxiv_id, observed 2026-05-11T00:00:54.030745Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:f4d98b4dc45a87914a7e0f33135361bce5d5792d6eef650996338e14b8a8d185

Observation 3fceaab3-107f-4325-8138-bdfdfc87eca0 · outbound

This paper cites an unresolved cited work.

Does Pass Rate Tell the Whole Story? Evaluating Design Constraint Compliance in LLM-based Issue Resolution Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-05-16T15:51:06.267133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-10T18:45:06.682021Z digest=sha256:0abd969a0251e7e358dc8026e72d552ba6810a40bf55c41dd001d06fab1b69b9

Pith citing papers

No inbound Pith citation observations are available.