Pith. sign in

Paper Citation Record · LEDGER

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

As of 8 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 1 inbound Pith citation observation for arXiv:2505.16086.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.16086 v2

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:12:37.571410Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T09:15:50.722199Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T09:59:45.569733Z

Reference resolution

16 of 16 outbound references displayed

  • verified exact0
  • verified fuzzy3
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 57b00b07-afb6-4d20-ba64-ea9719ff3a75 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.782597Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:36.358440Z digest=sha256:fe2fee3ac0600ba81523e585deb23e880afea368842b1e075c92ce29d6cd11a1

Observation 71262754-d894-4f4a-a2d8-3c63aa8ffb1a · outbound

This paper cites LLM Critics Help Catch LLM Bugs.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development LLM Critics Help Catch LLM Bugs

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.041322Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.041322Z digest=sha256:3d67406da80e950a33d15bf10b76025238f603849fd8d03599c6439566b8ec49

Observation 98e47070-f628-431a-ac88-05df882335ec · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.585217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:36.586932Z digest=sha256:36808642b1c58401b6bed2b6c8d216bc781c0ef48e5991564429a6401c059e8d

Observation 1d40cc74-272d-4687-9d18-d4850bbb55ae · outbound

This paper cites WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.251017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.251017Z digest=sha256:e449cb903e92bf7b2e8a8b9167d5a3294d0b8ec3bd53b197aab8093a2aa2fc56

Observation 9f28627f-3974-402b-964b-0fe607ad1f7b · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.404875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:36.791139Z digest=sha256:1ded016bb277b4b9e19b634bc8bd3281e42ce519de76ffda713543fe3b273db0

Observation 36dee761-64ea-4b8d-9d41-123262036a44 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.679996Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:36.481980Z digest=sha256:44afb532fbd802b4754062643321ba73c4707e38f54ce6caabe82e2b930a3fff

Observation f4e3ab12-0489-4a29-b318-a70e628e31d8 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.237594Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:37.064525Z digest=sha256:a5518e019a5a9a65b61e53b9542581a9ca34501dc36c98420ae3bce7ab4b1fae

Observation 4d2f308d-738b-49af-a260-1f452613de33 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.494608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:36.703811Z digest=sha256:f54f822acd8e8088bfad6bbe6435a1774af74d2a80390226ca6f015504b618fb

Observation 6cc156d8-ba53-45b8-bbba-2e984b9963bc · outbound

This paper cites [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:38.045532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:37.285129Z digest=sha256:94e4e9ebb5e723f079d0621cf1a6a0e5d98356d6c1de55df9cdf05db21268ce1

Observation 681e4ec4-8574-48fa-a8a7-a27b9b38d9b3 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.306417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:36.917159Z digest=sha256:3983c71ba5f270280c0c5c811061c2f41e173746b9bdb789c3dde9276bed0d3e

Observation 10a5ce6f-4cb1-41e6-b48b-535240aad065 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.132630Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:37.154983Z digest=sha256:b3c548f75e22429afba4a6dd05d44a38ca66a298af34b50752f94368c81227b9

Observation f8935d43-7e96-4562-8f22-c4d6afbb098e · outbound

This paper cites Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.969111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:37.407708Z digest=sha256:93e232ec6b185011ba4ef3bfd1232418b1014f3399e8fa9af059fda644e34bfc

Observation d7b08d7d-f738-412f-aef9-f665d7bb29af · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:37.871770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:37.514578Z digest=sha256:ad6f08016b08f31ee795176d1a89a8a87fad364655b3e13cf0a149c413df620d

Observation 1353e1ea-4895-410a-a754-6a1c95e2341a · outbound

This paper cites Figure 11: System and user prompt for the locator.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Figure 11: System and user prompt for the locator

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.771103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:12:37.571410Z digest=sha256:aceff4386d3c978cdb4d670f8b230b9a7438dffbf17e66ea6a5bcdbe1ac8518c

Observation 3d8921f6-1766-48cb-933d-8a5b6c724a3d · outbound

This paper cites gradient descent.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development gradient descent

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.161058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.161058Z digest=sha256:d1f60f81da99641da7b57881240d38665e119bcfb4c0d2744810e9cd38bc8bc2

Observation 91b3e1b9-12ac-4838-af70-ffc9c0e8bcb1 · outbound

This paper cites Are Large Language Models Good Prompt Optimizers?.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Are Large Language Models Good Prompt Optimizers?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:35.988542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:35.988542Z digest=sha256:239f4ea64426f2219a32b32d52805e596aced7fd46da692c34788602b6804ba0

Pith citing papers

Observation 99e7ba12-07d0-4657-a0d8-cac8af1da849 · inbound

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? cites this paper.

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

Reference 51

Resolution
verified exact
arxiv_id, observed 2026-07-04T09:59:45.571119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-06-26T09:15:50.722199Z digest=sha256:9118a7b073b12bba756dd7132a6f04f2b0cc83003580e9317295e1635dc2bba6