Pith. sign in

Paper Citation Record · LEDGER

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations

As of 19 August 2026, this Paper Citation Record lists 66 of 66 outbound references and 0 inbound Pith citation observations for arXiv:2505.05445.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.05445 v2

Coverage vector

measured 66 of 66 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T23:08:12.028546Z

measured 66 of 66 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

66 of 66 outbound references displayed

  • verified exact0
  • verified fuzzy25
  • unresolved40
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 907bed5d-a6bf-442f-80b1-334a62169694 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.446089Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.549825Z digest=sha256:4c636994b51c82a1a4ede95642fa11686c70affc6e840f14290fdb699785d74c

Observation 34ccef67-43d4-458d-aef5-344a80638106 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.423542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.557225Z digest=sha256:d42c0546d9a17e20f4c2aeefdd80fcd1af5eef81335cd0c9aafb507011ba00f6

Observation 5fb3cfe9-1840-4273-b8d7-04a06328507d · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.403762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.565179Z digest=sha256:79cf7a1d3b31870d32f7e77b2b3b9b53d1530a0dcc1b20becb26f87b6673cb12

Observation 16639a4a-f265-4bea-ace3-a4bba488f0fc · outbound

This paper cites DARD: A Multi-Agent Approach for Task-Oriented Dialog Systems.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations DARD: A Multi-Agent Approach for Task-Oriented Dialog Systems

Reference 4

Resolution
metadata mismatch
local_arxiv, observed 2026-08-15T23:08:12.107557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.533824Z digest=sha256:589e8df1c241718c0bd9fbc211b90cbb869162b50a9c97553819bf12ab914b60

Observation 32394b58-82cc-4ceb-8751-4684d7ba9ba7 · outbound

This paper cites Single” refers to tasks within a single domain (Restaurant(R), Hotel(H), or Train(T)), while “Multi.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Single” refers to tasks within a single domain (Restaurant(R), Hotel(H), or Train(T)), while “Multi

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.383786Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.572474Z digest=sha256:0d58cef04ef48ec0fc09bf80eb458ed1c44b489932b5749fe21bc7bc44cd541d

Observation ae977ad7-b7bc-40eb-83df-827c94f13726 · outbound

This paper cites Lets begin Figure 6: Prompt template for the User Simulator, specifying the task description, interaction instructions, and response format guidelines.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Lets begin Figure 6: Prompt template for the User Simulator, specifying the task description, interaction instructions, and response format guidelines

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.160307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.661478Z digest=sha256:7d8cc0e16bfd27c577f3a6cb217f6192c7436f607e8adff6a3125b783f225351

Observation 01576dfd-0a10-43ba-9347-37bd7fe5fe31 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.140580Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.669955Z digest=sha256:6acc64ebfef65a77b321aff7fc91987096ad700884964914a08a4db2562d1505

Observation bd142308-b2ec-440d-b0dd-b1710653b2a0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.123308Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.675818Z digest=sha256:693f2f885bae366a59403961b7107cabd17644c9221785d6e91c831de4ec29a1

Observation e7fb71ef-f703-4529-89fb-dee6776a364b · outbound

This paper cites If the required information is not available in the returned records, apply additional filters to narrow down the results.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations If the required information is not available in the returned records, apply additional filters to narrow down the results

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.101004Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.681392Z digest=sha256:aa1d322c0b63353d7a2ad084957d143158ae000b40a97b5499acace3758adbb3

Observation 400b6989-a494-442e-84de-3515f89ecfb9 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.082232Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.687470Z digest=sha256:2e7612af8bc52d0966bfa149e0122f21e3461ddbdb40b578d57bae3cef2b66c4

Observation 14070b00-38ca-414f-91fd-7861b8861259 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.066106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.693004Z digest=sha256:45a261644f6d9c51e2c99c9f18cad2e0fe3cb277eee626f9682d088b261c3fb9

Observation fcd0f4da-a38c-4252-a089-7d67a3c306c1 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.048080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.699329Z digest=sha256:afc20d78919d943d2f223b60820b87c8f342083ef1f8ca5f74d6bc12ec91378e

Observation ec89b911-89c4-41b6-a6af-c70476bc0de8 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.030437Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.704573Z digest=sha256:e10cd640a1b8c32a21319c85a8e2d62f22034303a1ab332eb58aed8bcd4da26b

Observation 9c090d40-11e6-4688-acce-bbfd9db5b6f7 · outbound

This paper cites INSTRUCTIONS:.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations INSTRUCTIONS:

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.012016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.710531Z digest=sha256:6264bb37a41c310b16fdc0678a3d41e614df39a2895e2689dc9a6c5b3357b514

Observation 22a37baf-93f0-4aab-bd26-457990d418c0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.364401Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.717521Z digest=sha256:20c2360327cb517efda22611934cbb25b12bff9717eaf889bc9262c3ad3fb63b

Observation 9b975fe2-d00c-4a58-ad97-30639acb2afe · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.343234Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.723470Z digest=sha256:bee38a7f3238b0e99d815e46e0d0e7541d6b5846bd4e4715b8607c2c87e1be3b

Observation 6c208875-810b-43e1-b2a4-2984bf5c57d6 · outbound

This paper cites Do not add logic or interpretation beyond what is explicitly stated in the TASK.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Do not add logic or interpretation beyond what is explicitly stated in the TASK

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.323235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.728729Z digest=sha256:35d96ef4e0f3f9c184057fb082fd5b2780e55692b25d1c2c91395d7030dca972

Observation c5860fd8-b854-443c-bee7-917025cbe44b · outbound

This paper cites Maintain strict adherence to the original formatting.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Maintain strict adherence to the original formatting

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.303018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.735492Z digest=sha256:cc62b5887beaaee96d3dc33920d050deb904d29a42f6bea712bf675f382e5068

Observation db968260-6f71-43d7-8efc-08da1d6a1540 · outbound

This paper cites If the dialogue system provides alternative options close to the desired time, the you should accept a suitable nearby option that reasonably aligns with the goal.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations If the dialogue system provides alternative options close to the desired time, the you should accept a suitable nearby option that reasonably aligns with the goal

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.283977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.742347Z digest=sha256:520b6b83be7e2ccbce84313f84ffc3cc2a93a045ef20058819ef3ebc79f08f69

Observation c44332b8-7092-4c21-9446-876021605188 · outbound

This paper cites No additional text should follow/preceed.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations No additional text should follow/preceed

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.263466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.747466Z digest=sha256:1f70b1a1d1b25c725208302acacc7752f4eb05b1e61c02e985e78cf14156a149

Observation cd806017-94dd-44ee-bc2e-3ca182afff3c · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 35

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.241304Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.754113Z digest=sha256:e5b31cefe47cd7d408262fdf08249e05432744222a435c91c7fdf7f5bf6e2720

Observation 06b26831-bb77-4a94-b4c7-1162f8bbcd08 · outbound

This paper cites OUTPUT FORMAT.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations OUTPUT FORMAT

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.221403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.759521Z digest=sha256:17b25354580557d159eeb12062a7dc8cf0bb482afcada5afc86c3fb0cb9e8626

Observation 70b5ad72-d54e-4664-80c9-05e5302da2f0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.202296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.765472Z digest=sha256:91cfb8346f2c48d35078b5dedcd0cf9d6eaafb9874af746146c57f16d4b597af

Observation d13b24a0-dbb2-4e88-bd4b-723b6fb7a9d1 · outbound

This paper cites Do not add any customary comments (thank you, great etc.).

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Do not add any customary comments (thank you, great etc.)

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.180119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.770168Z digest=sha256:06a7029defb4692651c9091bc182015dbb3376b5e02bd47bf90a884d93d50c14

Observation 97a1fa13-528d-41bc-8473-9e389467c42e · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.992131Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.775275Z digest=sha256:9419c1b8204b4d6f21fbfc4a8980bd003205f7832ebacd872bcf2cc0d7aa5b50

Observation 07c661ea-b65c-4d31-b474-282536a4cbe1 · outbound

This paper cites Determine appropriate flow based on user input and available information b.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Determine appropriate flow based on user input and available information b

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.971765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.780866Z digest=sha256:fc5e901e83bf36e8e80b2570d7b061cd0769a6f3cc0fc499b754b91bab001b2e

Observation 3c95b3cc-db40-49fb-8dee-0a320b4217b6 · outbound

This paper cites Include all required fields and the response must be a valid JSON.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Include all required fields and the response must be a valid JSON

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.950946Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.787537Z digest=sha256:994db3182ad9aa10dd02b8142ed5499fb3e431099ca44d6231deab01b62be582

Observation 5c13c4d8-82f8-4257-ad87-f43169a347dd · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.901429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.799378Z digest=sha256:7af326cd21fff40b28655e7b4e03ebe6cb9b7a8c3321b1d0bb983bbb2b81bbe6

Observation 476411b6-5365-410e-81ea-beb2e7655030 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.879017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.804730Z digest=sha256:d2ff9caf77dff0c74881f8a51b77eb05e37ad2cfed559e8a9613f274a7a576ce

Observation b93d7e9e-fc37-4a76-bfbf-4f98f62204fb · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.858032Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.809945Z digest=sha256:75bcd35350d6e4fc0b283eaf753731130d77bf3bcb4b5612c95d25450349a12b

Observation 581c50c5-49a5-446c-aa86-82302916949a · outbound

This paper cites Never return multiple function calls in a single response.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Never return multiple function calls in a single response

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.812548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.820654Z digest=sha256:c99062b16eb857847038cd6cf5c8cfc6008f35ee2802f8c91b8eef0418b6a112

Observation 7c9be236-8f5b-40df-910a-b6447d75970e · outbound

This paper cites The task is completed ONLY if all the intentions are fulfilled.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations The task is completed ONLY if all the intentions are fulfilled

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.792357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.826846Z digest=sha256:ab352a0fb752059a17eda63d62a4f47fec81d264c548d072e52758e57bb4bdbb

Observation 68c7aa03-5380-45d0-86d7-4a24518ed800 · outbound

This paper cites In the dialogue, the user or the system could either be AI or human.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations In the dialogue, the user or the system could either be AI or human

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.771712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.833574Z digest=sha256:a0baafd68a4146f89fef261cd5487c10e033e917b1588f669c5a1f894628cf81

Observation f3fe30f7-8c56-459f-add3-ea87b54399db · outbound

This paper cites You should report a numeric rating from 1 to 3, where 3 represents the best coherence.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations You should report a numeric rating from 1 to 3, where 3 represents the best coherence

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.748698Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.841174Z digest=sha256:ded8cfa3b0896b04767ce57c5321e71f59aa96384ab0f239c0fa0b7bc995eb7e

Observation ef18a07d-f1a9-45fd-8f10-93f9246d89dc · outbound

This paper cites For dialogue-level diversity, you only need to evaluate the user.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations For dialogue-level diversity, you only need to evaluate the user

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.728888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.847118Z digest=sha256:1bf7867c450b08d86eb3b647489c62672615b6df7f4eacedcf7aa35baa5e56a0

Observation 4ceb158b-36f8-47c9-81fe-4f346d54fc85 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 52

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.704956Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.852987Z digest=sha256:c2f47d01f42b04af908f41b1cd461b97be2c43d41bf1315d7b0957e0bc1808f7

Observation cb0362ea-0dd5-46d6-a4cb-d6edb88e01e0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.683535Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.859434Z digest=sha256:e2e56b7941754ee53ff88df794b8e1f2522720288397d3cd134232a448bc8162

Observation 4a092fcd-d86d-4475-8b77-f90ea8c25d55 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 54

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.660118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.864691Z digest=sha256:eb8d8ddf2c7a32217e8a2e88bd8832beafe02369454a8877a2a6403be07959a0

Observation dcecedd9-f3dd-4fe2-8acf-d1bcf955b0fb · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.630827Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.870191Z digest=sha256:9e067b0356f8bc7055d31bc0863949f2cf19ba507fe0df6bbc1886ac7c00e057

Observation ccba7b6c-0166-40ad-9156-7dd034be9cc3 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.607919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.876084Z digest=sha256:bc4a852cc25029b1d91e90ad41910eeb138581d121f6f1aea43d4e95fc83229f

Observation 08c8aeac-bad8-4b99-9fae-d1ccce2b053e · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.588037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.881835Z digest=sha256:5af3514d6963dc0edf8e7fc6925ec611852970102a6f1ce6fcc3ae7c94e78503

Observation 26307476-c901-4cca-a601-2ae745c6384d · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 58

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.566805Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.889348Z digest=sha256:c06b4fa4c9311cd6879bcd39cbefdc8bf0bab61db3478e410cd0edf65a0ec754

Observation fcf601ce-8923-48cf-8509-0f31d7360d20 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.536473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.894397Z digest=sha256:270837d96fdc9df0d09448349c6d2e1b294b366960b39ac87de8ba7694af11c0

Observation 53a807a2-e8e0-4315-9bf0-d569e7a195ae · outbound

This paper cites donotcare.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations donotcare

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.514855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.900560Z digest=sha256:c8c7dc6271ea801761caf343b2fad4b0fe85f372c29da6bc7603eea52e4216b5

Observation bcbe4ba1-8370-4040-804f-463f03d35622 · outbound

This paper cites Dialogue history is provided to understand the context better.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Dialogue history is provided to understand the context better

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.487757Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.905816Z digest=sha256:2c4dd0f3d22e72cb13f18523f8713fd9698eb0eaf8b31f451a44559fbac563a8

Observation 33216a33-63b0-4a9f-afbe-bc75a9fe17aa · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 62

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.466774Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.910921Z digest=sha256:c72a5766bab1d98b7a281ba219b22b442291e6ddf7991b6466f53201c5d8caa5

Observation daacb79d-e931-4c82-9abb-636af78df642 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 63

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.442625Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.915875Z digest=sha256:f6a882e78d5c2df40277efccf0598e5db84dc5629e658b969c1b96e1a17a31c3

Observation 6fee7c14-4e68-41d5-b335-4a90890516a4 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 64

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.421182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.921090Z digest=sha256:360363512dbb0307f958b9d88732af64dadc9b26332a9eb36c3a8e28aeef6d3f

Observation 27358541-de90-459b-88ae-57543b934739 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 66

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.399229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.932498Z digest=sha256:4b54981f28a28580e0da2894760548bd621c63c4aec81fc203ba8c05ad661bbc

Observation 16d92e8e-6636-4500-bf5c-8bee7ffdcf45 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 67

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.377040Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.940850Z digest=sha256:8fbc59ee7e53755bfffb5cb742a09e70f4dcab7eddeb9d3cd75a40e25abb0c6e

Observation 46490a4a-45b4-4361-b2d4-339734b1f43d · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 68

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.358564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.951647Z digest=sha256:efad05a27e3382f6ec40b3792b3682d3ee34cce493f65817af688a14ab2e6b93

Observation a9d14941-4a0f-487e-887b-c2cab36f2b77 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 69

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.337299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.958834Z digest=sha256:6a109298f488a0adae3551a69dce0a2c593a69dfdd30901c0aa7bed003085000

Observation d1ce788f-bf88-4e1a-8ac2-e4cd63288316 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 70

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.312769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.966232Z digest=sha256:4f8cc59283ac51f362ef9939a218ba9ca4ad1c9525c76b6f762ce399c0aecc2e

Observation be36b129-bdcc-4a4a-a2a8-3bc6b95661b2 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 71

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.292363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.972973Z digest=sha256:0c7f937a7b44c9a09576a5d3cfb7cf640b74c9bf872550e1f30234c90fc49b1a

Observation e9264cdb-a551-4d12-914d-15a7011b5649 · outbound

This paper cites Do not infer, assume, or hallucinate values based on common patterns or prior examples.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Do not infer, assume, or hallucinate values based on common patterns or prior examples

Reference 72

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.269886Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.980091Z digest=sha256:d3471b4e180c320b17791af356a245958157be1ae317cc83de617f8a0897701c

Observation 3ed15598-4dd1-44c3-8db2-d6757b6828e6 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 73

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.247730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.987963Z digest=sha256:1441a5013e6444971c373386be571f203c1c50bacee389bd55f11d6c195b655a

Observation 8a08f849-167d-4b66-b691-f7efc88c957e · outbound

This paper cites area": ".

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations area": "

Reference 74

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.228769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.996719Z digest=sha256:50d83e287d8807595ce3b7ebb77527d718d67c053b98e7c3a71216e923a66431

Observation 3d5f2287-afab-475d-80b7-9a56b2ef5328 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 75

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.923185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.002912Z digest=sha256:93edf19da9b61fc2a651efa606fd2a816c72dc5c9406975dca2fe3291b4cb93a

Observation 2482252d-48f8-4021-9352-bbebacdfe242 · outbound

This paper cites Never respond with plain text.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Never respond with plain text

Reference 76

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.836983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.009465Z digest=sha256:53330fd90cc0f7f1fb478c85e423d0b9681cf4b8c6068f7e7fcb31f9e7a29642

Observation 717f6d3e-23cc-4578-9116-b0a4585a7b4a · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 77

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.210076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.015038Z digest=sha256:04c330ddb4346fff8e3050a5280867d15a6eed65da111ac7bee5e50f66c37478

Observation 868a9a4d-2155-48ea-b00e-50bbf09f2a3e · outbound

This paper cites If additional information is required to proceed, respond conversationally using direct and focused phrasing.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations If additional information is required to proceed, respond conversationally using direct and focused phrasing

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.189493Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.021994Z digest=sha256:10f23cbd8c2ac388fa43b1032c4b3208d4d6cac7ac345aee9ac18f41f2d3f593

Observation 56d952e2-6119-4edb-ae33-2ee7fff44b3a · outbound

This paper cites type": "function.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations type": "function

Reference 79

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.168848Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.028546Z digest=sha256:a563ce1e76353c0cef5c342c12637732929183a455e43f896969af629ccb24eb

Observation 07fb300f-a7b1-4fdf-90e9-ea9af9cb7d51 · outbound

This paper cites In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2877–2888, Online.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2877–2888, Online

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.471681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.519127Z digest=sha256:1dbac3d5f8ee5d1c34d59ba5927597f888d76147c48c8e66a21c137424756583

Observation c983d5c9-9f91-44b9-956b-035bc07ceb5c · outbound

This paper cites User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-15T23:08:11.511635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T23:08:11.511635Z digest=sha256:ebb07974161090811c6053855f916af8d0d5ff06c63b26d7190e7b824159cd7b

Observation a874f7cc-db01-4b80-9b9a-23b973640b92 · outbound

This paper cites The Llama 3 Herd of Models.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations The Llama 3 Herd of Models

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-15T23:08:11.525565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T23:08:11.525565Z digest=sha256:003edc6e2bae7ce6a8b5e0f2ae008e87380bb35cca39e630adbcb5d5cce87978

Observation 74478500-8350-4ab8-af79-28af5d0e775e · outbound

This paper cites A Comprehensive Assessment of Dialog Evaluation Metrics.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations A Comprehensive Assessment of Dialog Evaluation Metrics

Reference 2763

Resolution
unresolved
no resolver link, observed 2026-08-15T23:08:11.541632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T23:08:11.541632Z digest=sha256:96cf172c7c70c18d96211f16575f855270ecace7e893e09a2c47453540f06f8d

Pith citing papers

No inbound Pith citation observations are available.