Pith. sign in

Paper Citation Record · LEDGER

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

As of 8 August 2026, this Paper Citation Record lists 16 of 16 outbound references and 1 inbound Pith citation observation for arXiv:2505.16086.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.16086 v2

Coverage vector

measured 16 of 16 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:12:37.571410Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T09:15:50.722199Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T09:59:45.569733Z

Reference resolution

16 of 16 outbound references displayed

  • verified exact0
  • verified fuzzy3
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 57b00b07-afb6-4d20-ba64-ea9719ff3a75 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.782597Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:36.358440Z digest=sha256:7d0ef02b2a24dac8e9b5899a7c95d517dcbb8f84171265d48b882ff1d00c73b7

Observation 71262754-d894-4f4a-a2d8-3c63aa8ffb1a · outbound

This paper cites LLM Critics Help Catch LLM Bugs.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development LLM Critics Help Catch LLM Bugs

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.041322Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.041322Z digest=sha256:3d67406da80e950a33d15bf10b76025238f603849fd8d03599c6439566b8ec49

Observation 98e47070-f628-431a-ac88-05df882335ec · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.585217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:36.586932Z digest=sha256:f0f4ab9c6c9a8c00f71d0649a839c15e475dca3bd073b494f2bf818de822cfc9

Observation 1d40cc74-272d-4687-9d18-d4850bbb55ae · outbound

This paper cites WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.251017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.251017Z digest=sha256:e449cb903e92bf7b2e8a8b9167d5a3294d0b8ec3bd53b197aab8093a2aa2fc56

Observation 9f28627f-3974-402b-964b-0fe607ad1f7b · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.404875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:36.791139Z digest=sha256:8bdf0e701eca9fc1c7911368865c0811001ef9dd135db977148bf07ae71b7a8d

Observation 36dee761-64ea-4b8d-9d41-123262036a44 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.679996Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:36.481980Z digest=sha256:3b61f31fc706376aad23cd06683756b2d4fd94bd093f5a23c98091736a8512a8

Observation f4e3ab12-0489-4a29-b318-a70e628e31d8 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.237594Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:37.064525Z digest=sha256:16ca36026eb4f6c9062852b5773d341e841fd5058100d3d1a4854907b4891776

Observation 4d2f308d-738b-49af-a260-1f452613de33 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.494608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:36.703811Z digest=sha256:9e6dbc5b8cb3b1c2c697cc0cfa3f5103ee655024aba993c89e07ce1d26e09736

Observation 6cc156d8-ba53-45b8-bbba-2e984b9963bc · outbound

This paper cites [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development [/Experts pool] You need to recruit a total of ${number of agents} experts from the above expert pool to collaboratively solve the given task

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:38.045532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:37.285129Z digest=sha256:7042b30f3f29eb739018d2954415d8b788250640626dff16b63035305cf99f22

Observation 681e4ec4-8574-48fa-a8a7-a27b9b38d9b3 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.306417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:36.917159Z digest=sha256:f3b83b5aebc8d7361ed5202cb0152975c47e6a152e39214a38d5f33bda0df23c

Observation 10a5ce6f-4cb1-41e6-b48b-535240aad065 · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:38.132630Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:37.154983Z digest=sha256:5c58c66778a4c5a8c0fbe5a98aec11455f64109471a58b0e35b8667195c42411

Observation f8935d43-7e96-4562-8f22-c4d6afbb098e · outbound

This paper cites Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Also, make sure that you only give a high score when the solution code is really good at satisfying the definition of the evaluation dimension

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.969111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:37.407708Z digest=sha256:aa6cd31c1dfb93e9041d0fe5fe4b5ea8368e3f004cd7f26946b9a2fd557b2344

Observation d7b08d7d-f738-412f-aef9-f665d7bb29af · outbound

This paper cites an unresolved cited work.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:12:37.871770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:37.514578Z digest=sha256:22c6bdfe1f44e91f4986a30b930927cec69e2c205191437353c144e34e842d7d

Observation 1353e1ea-4895-410a-a754-6a1c95e2341a · outbound

This paper cites Figure 11: System and user prompt for the locator.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Figure 11: System and user prompt for the locator

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:12:37.771103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:12:37.571410Z digest=sha256:0714fc3bebfbaff3674732bcdbc94536ffe70c62b91dfdef22f2474ad238df59

Observation 3d8921f6-1766-48cb-933d-8a5b6c724a3d · outbound

This paper cites gradient descent.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development gradient descent

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:36.161058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:36.161058Z digest=sha256:d1f60f81da99641da7b57881240d38665e119bcfb4c0d2744810e9cd38bc8bc2

Observation 91b3e1b9-12ac-4838-af70-ffc9c0e8bcb1 · outbound

This paper cites Are Large Language Models Good Prompt Optimizers?.

Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development Are Large Language Models Good Prompt Optimizers?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:35.988542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:35.988542Z digest=sha256:239f4ea64426f2219a32b32d52805e596aced7fd46da692c34788602b6804ba0

Pith citing papers

Observation 99e7ba12-07d0-4657-a0d8-cac8af1da849 · inbound

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? cites this paper.

MAS-PromptBench: When Does Prompt Optimization Improve Multi-Agent LLM Systems? Optimizing LLM-Based Multi-Agent System with Textual Feedback: A Case Study on Software Development

Reference 51

Resolution
verified exact
arxiv_id, observed 2026-07-04T09:59:45.571119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-26T09:15:50.722199Z digest=sha256:aeb1a11a3744ba33163eb302457ad457cc1ad40bcac579d03f2d3342d4ecfb34