Paper Citation Record · LEDGER

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol

As of 21 August 2026, this Paper Citation Record lists 79 of 79 outbound references and 4 inbound Pith citation observations for arXiv:2508.20737.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.20737 v1

Coverage vector

measured 79 of 79 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-05T14:55:57.149621Z

measured 83 of 83 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-14T04:39:16.254296Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-14T18:27:35.988372Z

Reference resolution

79 of 79 outbound references displayed

verified exact9
verified fuzzy3
unresolved65
parse uncertain0
malformed identifier0
metadata mismatch2

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation c55a3bf4-fbcb-4f7d-bcef-9c9871ae8012 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.467675Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 9792c7c3-c68f-4639-b557-eb9fff3d17d7 · outbound

This paper cites RT-DEMT: A hybrid real-time acupoint detection model combining mamba and transformer.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol RT-DEMT: A hybrid real-time acupoint detection model combining mamba and transformer

Reference 2

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:58.355877Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 95e9e596-5b56-4fb8-989b-ebcff1bec348 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.441221Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1d01ba7c-0b5c-48bf-bfc3-46c19d2fa3eb · outbound

This paper cites Comparing Template-based and Template-free Language Model Probing.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Comparing Template-based and Template-free Language Model Probing

Reference 4

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:58.312538Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation ea7c5c1b-9d02-4b88-a817-e64f8e5a4641 · outbound

This paper cites The challenge of uncertainty quantification of large language models in medicine.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol The challenge of uncertainty quantification of large language models in medicine

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.599407Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a958640-6a0a-4346-9b45-9f4591b7bfef · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 6

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.421012Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 0eba8e96-c5a6-4611-b34f-f0b80bd2f63d · outbound

This paper cites AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.613822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation acf88411-b63d-48fb-b313-e496a2ab95a3 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.398639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 324b7a8e-1c16-45c3-8805-c88422d7cf88 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.624966Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 48ed4903-51f0-4e39-8ca4-b2256e3a8d47 · outbound

This paper cites Open Source Software Development Tool Installation: Challenges and Strategies For Novice Developers.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Open Source Software Development Tool Installation: Challenges and Strategies For Novice Developers

Reference 10

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:58.225969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation f5a1c7ab-eee6-4778-be33-21a71542cba3 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 11

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.350663Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation f39f7150-d605-4afc-88ab-70ca8796345c · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.328141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation b85f1fae-eb24-4b35-8809-a643c135740c · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.306755Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation f54cebe6-bb20-4258-a935-52c03616e059 · outbound

This paper cites Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.658737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 74526514-5f58-4b19-a06b-67597f6aecc0 · outbound

This paper cites MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol MORTAR: Multi-turn Metamorphic Testing for LLM-based Dialogue Systems

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.666623Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67113337-027c-4aaf-9106-a1573be0ed74 · outbound

This paper cites The Polynomial Stein Discrepancy for Assessing Moment Convergence.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol The Polynomial Stein Discrepancy for Assessing Moment Convergence

Reference 16

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:58.134868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1a8fadaa-f632-46e4-83fb-69004ddfcf6c · outbound

This paper cites PDL: A Declarative Prompt Programming Language.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol PDL: A Declarative Prompt Programming Language

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.688595Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d53ea499-161f-4e92-be98-bf47177c972e · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.286823Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 255bd1de-8be6-46c6-96e0-7b1f2b1018f9 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 19

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.251398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 9f3c6ad4-6441-456c-889d-cbb90cd72e2e · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.230715Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 23b53468-51b3-49de-ac4c-1922d467bdd8 · outbound

This paper cites Ali Babar.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Ali Babar

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.710019Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe9ec376-0832-45d9-b5a5-25a1f877311e · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 22

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.209673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 3a2780af-ef10-4682-955b-d6874b34eb18 · outbound

This paper cites A Survey on Large Language Models for Code Generation.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol A Survey on Large Language Models for Code Generation

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.721520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b1e576c2-ed03-4fa8-88c0-4889c800deb9 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.192223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 0a3babf2-056b-48f8-98c1-67bbc5c063c8 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.165280Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 352f16cb-95da-4c73-a22f-f9981c559a6d · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.140510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 96bcb577-6a30-41b6-b1c1-1436f43f0a45 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.745992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 945d1dc9-175d-42de-9959-0883a4b0a4e2 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 28

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.116417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation d84deca7-9045-4bf6-a192-c79b6d55c023 · outbound

This paper cites Predicting Future States with Spatial Point Processes in Single Molecule Resolution Spatial Transcriptomics.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Predicting Future States with Spatial Point Processes in Single Molecule Resolution Spatial Transcriptomics

Reference 29

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:57.962262Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 644ff004-28d5-44c6-8f8b-2c18d7de6653 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 30

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.096338Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 5cde7bc1-3d23-436f-88af-ccf2790ede52 · outbound

This paper cites G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.772682Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7b814d8-09dd-465d-a243-687b6054e432 · outbound

This paper cites Prompt Injection attack against LLM-integrated Applications.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Prompt Injection attack against LLM-integrated Applications

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.779160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b825ae9b-c38f-4d02-8b55-50d5ccea1d3b · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 33

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.071758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 82f5b369-d403-4525-a90d-214c6a12a417 · outbound

This paper cites Demystifying AI Agents: The Final Generation of Intelligence.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Demystifying AI Agents: The Final Generation of Intelligence

Reference 34

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:57.895648Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 761e903c-e49a-4a87-985b-4add0b1736ba · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 35

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:59.019852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 0e79e55e-646b-4c43-9bb9-e243242f6b1b · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 36

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.986123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 128d9a4c-ae6f-4020-af32-5158c826c673 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 37

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.965290Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 40c35cb1-de87-4a17-ab6e-e16c687b1db8 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 38

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.935067Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation df0eaa47-20f0-4569-bc08-532bdaee9139 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.845762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5de0c5d6-1937-49a5-83cb-34e67eec72a6 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 40

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.916713Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation d6f73424-395e-4c40-9fbc-119d3a86cfcb · outbound

This paper cites BBQ: A Hand-Built Bias Benchmark for Question Answering.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol BBQ: A Hand-Built Bias Benchmark for Question Answering

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.858616Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b1179c82-c43f-4a96-8dd2-e833ec0f6935 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.866651Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3c591527-287c-4bd4-9398-37f6ed78d015 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 43

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.881403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 4aac3a6c-9716-4744-8562-b62b8ee1d18c · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 44

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.857459Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 0f2a2750-9a46-4f7d-ba1d-aad338088efd · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 45

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.834822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 9c4b9563-406b-4bda-aed6-71d774af6ffd · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 46

Resolution: metadata mismatch; raw_fallback, observed 2026-08-05T14:55:57.753297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 052f3e24-220c-4c6b-811f-1f4d170eaaa4 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 47

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.807636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation a69bd01b-6c02-43a3-a5bb-17ad393b277b · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 48

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.778931Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1893962d-e292-44ae-86b8-62beb335e313 · outbound

This paper cites Nuclear Weak Rates and Nuclear Weak Processes in Stars.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Nuclear Weak Rates and Nuclear Weak Processes in Stars

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.920125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd3b19a8-45bb-4b07-b301-d5d2c46734e0 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 50

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.743242Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1f420ccb-4227-4af8-b00a-7a201371f4c2 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 51

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.719470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 3cef5832-94ab-44db-9355-47b5448df3f3 · outbound

This paper cites Pan, and Kam-Fai Wong.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Pan, and Kam-Fai Wong

Reference 52

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T14:55:58.701677Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation fd59f1b9-0c8c-4ea6-ba16-ec5350a843b2 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 53

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.683162Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation e77ea812-1687-4768-8b47-98b8d0fe6fb9 · outbound

This paper cites Jailbroken: How Does LLM Safety Training Fail?.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Jailbroken: How Does LLM Safety Training Fail?

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:56.967504Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dc7b1fa3-e8ba-4064-af91-047742546b80 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 55

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.660360Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 14d6cc01-a60b-43f7-b321-55bf7b210fad · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 56

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.633359Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 5f06dcbf-0678-4029-9cce-bdd117e0c4b7 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 57

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.617262Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 35569624-53a6-4931-88c8-9e40ff5baec7 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 58

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.596982Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation e06d62fa-6e15-40be-b095-bc0bb8cb5e63 · outbound

This paper cites Efficient Adversarial Training in LLMs with Continuous Attacks.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Efficient Adversarial Training in LLMs with Continuous Attacks

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.009096Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0db94f43-530f-4e45-8b92-3f23d336b847 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 60

Resolution: metadata mismatch; raw_fallback, observed 2026-08-05T14:55:57.571740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 47d475ce-9be0-4cba-91da-45f6d2c7e757 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 61

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.576867Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation d578f0ac-f7f0-4d2c-aab6-586c557e8c5e · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.030643Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d9797649-cc86-49b0-821e-3fd5a6268254 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 63

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.516135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation a4f9dc18-43ee-4f7b-b31c-87e0b6741f14 · outbound

This paper cites Assessing Adversarial Robustness of Large Language Models: An Empirical Study.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Assessing Adversarial Robustness of Large Language Models: An Empirical Study

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.051121Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation caee333a-96c6-41bc-a663-2f82e8008b74 · outbound

This paper cites Risks When Sharing LoRA Fine-Tuned Diffusion Model Weights.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Risks When Sharing LoRA Fine-Tuned Diffusion Model Weights

Reference 65

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:57.421789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation b303c104-4881-4cbe-b929-1f0c5c085ce3 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.065458Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 36921211-67bb-4dcb-a04f-3412bb47b307 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 67

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.471049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation ce1cf4c6-1043-4e6a-b25d-f0f72f32fcaa · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 69

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.436154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation bd9f13fe-50f5-4163-85be-ca0af4abb867 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 70

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.416183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 90b6b936-21da-4fa6-b84c-7b8af5f51a70 · outbound

This paper cites DeepRoad: GAN-based Metamorphic Autonomous Driving System Testing.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol DeepRoad: GAN-based Metamorphic Autonomous Driving System Testing

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.108617Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a02c6a6-af5d-459b-b068-573861e8dcde · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 72

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.398541Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 09c932e2-53ff-4c99-8d10-67e90febaaf4 · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.119618Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d2ebda94-a837-4763-94fa-73bb1922e317 · outbound

This paper cites an unresolved cited work.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Unresolved cited work

Reference 74

Resolution: unresolved; raw_fallback, observed 2026-08-05T14:55:58.381379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation dfcadb4f-20de-4dc2-aa25-af2af6a0e2eb · outbound

This paper cites Brain-inspired Artificial Intelligence: A Comprehensive Review.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Brain-inspired Artificial Intelligence: A Comprehensive Review

Reference 75

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:57.297737Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 7d6e74f0-a841-404e-8c1d-75b51a8961e8 · outbound

This paper cites Boosting Backdoor Attack with A Learnable Poisoning Sample Selection Strategy.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Boosting Backdoor Attack with A Learnable Poisoning Sample Selection Strategy

Reference 76

Resolution: verified exact; local_arxiv, observed 2026-08-05T14:55:57.265235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation bad383c9-0501-44b7-a64c-b3b087a692e3 · outbound

This paper cites Universal and Transferable Adversarial Attacks on Aligned Language Models.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Universal and Transferable Adversarial Attacks on Aligned Language Models

Reference 77

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.149621Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation db4bad04-64a1-4ef7-a194-564a338444a6 · outbound

This paper cites In 2018 IEEE 29th international symposium on software reliability engineering (ISSRE).

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol In 2018 IEEE 29th international symposium on software reliability engineering (ISSRE)

Reference 2018

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T14:55:59.044399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation ac31dc78-0329-431f-8d4b-9fd37ebf0f10 · outbound

This paper cites CoRR (2024).

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol CoRR (2024)

Reference 2024

Resolution: verified fuzzy; raw_fallback, observed 2026-08-05T14:55:58.538559Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 67de1d8f-02de-46bc-80c6-fab826e8eb3a · outbound

This paper cites Survey on Evaluation of LLM-based Agents.

Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol Survey on Evaluation of LLM-based Agents

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-05T14:55:57.079971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 6262d467-f1b4-4798-9d3d-e3fe8c67f793 · inbound

AAFLOW: Scalable Patterns for Agentic AI Workflows cites this paper.

AAFLOW: Scalable Patterns for Agentic AI Workflows Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol

Reference 1

Resolution: verified exact; arxiv_id, observed 2026-05-11T17:36:06.490183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation d6940de9-c3c3-4093-a947-94f5c2e368e2 · inbound

How to Interpret Agent Behavior cites this paper.

How to Interpret Agent Behavior Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol

Reference 33

Resolution: verified exact; arxiv_id, observed 2026-05-14T18:27:35.992206Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1d59b4b6-9e98-4c7c-bc1a-822e472ce05e · inbound

OpRAG: A Resource-Deterministic Runtime for GPU-Backed Multi-Stage RAG Workflows cites this paper.

OpRAG: A Resource-Deterministic Runtime for GPU-Backed Multi-Stage RAG Workflows Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-12T00:12:18.966953Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f31e18c2-75cd-4370-8fd8-13b7333b2e66 · inbound

Tangent: An Empirical Study of Testing Practices for LLM-Based Agent Applications cites this paper.

Tangent: An Empirical Study of Testing Practices for LLM-Based Agent Applications Rethinking Testing for LLM Applications: Characteristics, Challenges, and a Lightweight Interaction Protocol

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-14T04:39:16.254296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.