Pith. sign in

Paper Citation Record · LEDGER

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations

As of 19 August 2026, this Paper Citation Record lists 66 of 66 outbound references and 0 inbound Pith citation observations for arXiv:2505.05445.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.05445 v2

Coverage vector

measured 66 of 66 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T23:08:12.028546Z

measured 66 of 66 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

66 of 66 outbound references displayed

  • verified exact0
  • verified fuzzy25
  • unresolved40
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 907bed5d-a6bf-442f-80b1-334a62169694 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.446089Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.549825Z digest=sha256:e310904d248dd4c528a814c33ef49730c1fdb3698d241ea51eacba48d71b9500

Observation 34ccef67-43d4-458d-aef5-344a80638106 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.423542Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.557225Z digest=sha256:d9a285ad9cfb440352b017a682c99089f45ce18b30dc07eff93e3193eb87df79

Observation 5fb3cfe9-1840-4273-b8d7-04a06328507d · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.403762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.565179Z digest=sha256:1dee9174b4239ed4a47d18c9c69fc5a154f31b9b46d5a60b7fee82cfbc9fc1f4

Observation 16639a4a-f265-4bea-ace3-a4bba488f0fc · outbound

This paper cites DARD: A Multi-Agent Approach for Task-Oriented Dialog Systems.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations DARD: A Multi-Agent Approach for Task-Oriented Dialog Systems

Reference 4

Resolution
metadata mismatch
local_arxiv, observed 2026-08-15T23:08:12.107557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.533824Z digest=sha256:0ba355f4b4b828a855d5b6d799eaa5d6a6a023add99d5d8249ecf39631b4a533

Observation 32394b58-82cc-4ceb-8751-4684d7ba9ba7 · outbound

This paper cites Single” refers to tasks within a single domain (Restaurant(R), Hotel(H), or Train(T)), while “Multi.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Single” refers to tasks within a single domain (Restaurant(R), Hotel(H), or Train(T)), while “Multi

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.383786Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.572474Z digest=sha256:406ffea8d3038ea8fc70de5146e2e854bf91b2b2011ad1dd7010bcddd497e7b4

Observation ae977ad7-b7bc-40eb-83df-827c94f13726 · outbound

This paper cites Lets begin Figure 6: Prompt template for the User Simulator, specifying the task description, interaction instructions, and response format guidelines.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Lets begin Figure 6: Prompt template for the User Simulator, specifying the task description, interaction instructions, and response format guidelines

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.160307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.661478Z digest=sha256:c1600812d59ea7e9f12227bfed7bf84f06e0b937a76c1c2d739f42640e88201a

Observation 01576dfd-0a10-43ba-9347-37bd7fe5fe31 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.140580Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.669955Z digest=sha256:bdb978cfab804d8f4cf1d464b88f28564adae93dab48f44b927bbe109aea3501

Observation bd142308-b2ec-440d-b0dd-b1710653b2a0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.123308Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.675818Z digest=sha256:53e0c01f694eb60dc2d734dffb864e79c65796f6c1b2933aa2f0927d1490ab22

Observation e7fb71ef-f703-4529-89fb-dee6776a364b · outbound

This paper cites If the required information is not available in the returned records, apply additional filters to narrow down the results.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations If the required information is not available in the returned records, apply additional filters to narrow down the results

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.101004Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.681392Z digest=sha256:1693076831bbb60cb36d14a8718233eddfa5361cc2c539f3adfc56b7e4115714

Observation 400b6989-a494-442e-84de-3515f89ecfb9 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.082232Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.687470Z digest=sha256:51874c259cf5e25378c75a31c510890fcb506db38ff96b236cf8b15db94fe35f

Observation 14070b00-38ca-414f-91fd-7861b8861259 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.066106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.693004Z digest=sha256:53d1e9783f79a8ad99c1a1b2492fd43f922914e94d33ea75d5154ac260e883b7

Observation fcd0f4da-a38c-4252-a089-7d67a3c306c1 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.048080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.699329Z digest=sha256:12d558f10360058431211a7261529d906f6949487330bcdd3347e695dc554652

Observation ec89b911-89c4-41b6-a6af-c70476bc0de8 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.030437Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.704573Z digest=sha256:5b27d688331b726aa7a00c6782e61b6691656b1134dc8e025eff631ca68e78f0

Observation 9c090d40-11e6-4688-acce-bbfd9db5b6f7 · outbound

This paper cites INSTRUCTIONS:.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations INSTRUCTIONS:

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.012016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.710531Z digest=sha256:aebf654f8e402d5077fe2e35a4ceedcbad7d9220534f58330402dcc9c1cd57f8

Observation 22a37baf-93f0-4aab-bd26-457990d418c0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.364401Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.717521Z digest=sha256:8cfdd260926d3eba9d141464caa7a63c75ad2dd540bea65108085377d5bb1dca

Observation 9b975fe2-d00c-4a58-ad97-30639acb2afe · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.343234Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.723470Z digest=sha256:6821e8c3399a60701489ca1cf65b93b3a17cb1939e20598d7573db854e01c08e

Observation 6c208875-810b-43e1-b2a4-2984bf5c57d6 · outbound

This paper cites Do not add logic or interpretation beyond what is explicitly stated in the TASK.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Do not add logic or interpretation beyond what is explicitly stated in the TASK

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.323235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.728729Z digest=sha256:d8b8056becd2300c086f368b87aa20f43d84b28608bf1f89d0b7189087eb97f3

Observation c5860fd8-b854-443c-bee7-917025cbe44b · outbound

This paper cites Maintain strict adherence to the original formatting.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Maintain strict adherence to the original formatting

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.303018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.735492Z digest=sha256:35332c5b2d7a3c9893bb4fefc65edb598ec5d85cdb7dd099862f6858423cfba3

Observation db968260-6f71-43d7-8efc-08da1d6a1540 · outbound

This paper cites If the dialogue system provides alternative options close to the desired time, the you should accept a suitable nearby option that reasonably aligns with the goal.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations If the dialogue system provides alternative options close to the desired time, the you should accept a suitable nearby option that reasonably aligns with the goal

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.283977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.742347Z digest=sha256:b746918a316721d47f2231ad82d1b74172bc244d1979be0c52b7264d8f5d7295

Observation c44332b8-7092-4c21-9446-876021605188 · outbound

This paper cites No additional text should follow/preceed.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations No additional text should follow/preceed

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.263466Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.747466Z digest=sha256:bd48a0b18be05de5105ea6e02f7ffa7b51556ebbd62e13692cc8244dc3251d08

Observation cd806017-94dd-44ee-bc2e-3ca182afff3c · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 35

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.241304Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.754113Z digest=sha256:51ec6ce6c80c6b15143b6da3bb0793024a32ec87db16cac0652588be2168287d

Observation 06b26831-bb77-4a94-b4c7-1162f8bbcd08 · outbound

This paper cites OUTPUT FORMAT.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations OUTPUT FORMAT

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.221403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.759521Z digest=sha256:e7b75d4996e641a98c85aeaab022186e92faebb4e9fc7149eb4e33dc0ead0289

Observation 70b5ad72-d54e-4664-80c9-05e5302da2f0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:13.202296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.765472Z digest=sha256:9325c276f155a86182a8457eeb4ce7a3d6dd2cb4c440dfa9b01ee0b3663afe2d

Observation d13b24a0-dbb2-4e88-bd4b-723b6fb7a9d1 · outbound

This paper cites Do not add any customary comments (thank you, great etc.).

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Do not add any customary comments (thank you, great etc.)

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.180119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.770168Z digest=sha256:4e6a8d79919e60c20681045c3dc4bb1bd2949d9185ad73b0809800c549c84e03

Observation 97a1fa13-528d-41bc-8473-9e389467c42e · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.992131Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.775275Z digest=sha256:2618059b5bc80713d480ed76a07e40681113450689005e5c09eef6c99aa1f86f

Observation 07c661ea-b65c-4d31-b474-282536a4cbe1 · outbound

This paper cites Determine appropriate flow based on user input and available information b.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Determine appropriate flow based on user input and available information b

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.971765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.780866Z digest=sha256:be9b7fb791674a69e20ee580d2bb017f81c1125a7e0fd64d9d7a0f652034d93d

Observation 3c95b3cc-db40-49fb-8dee-0a320b4217b6 · outbound

This paper cites Include all required fields and the response must be a valid JSON.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Include all required fields and the response must be a valid JSON

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.950946Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.787537Z digest=sha256:99a35d0f7e60223285086c948886c751237af264b79c276af2eafa0a1663eeb3

Observation 5c13c4d8-82f8-4257-ad87-f43169a347dd · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.901429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.799378Z digest=sha256:41a79d6634fdb31acccf042031a04ef96d33484e54b302dc7023978f09497083

Observation 476411b6-5365-410e-81ea-beb2e7655030 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.879017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.804730Z digest=sha256:9300873a0453297503f6128356a0daa5651d7888b78f490a0622875275b11e04

Observation b93d7e9e-fc37-4a76-bfbf-4f98f62204fb · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.858032Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.809945Z digest=sha256:7c17b2c272a186bf4dd8270d08cc756f6fda6b2d577a42a36b9e052515d868fc

Observation 581c50c5-49a5-446c-aa86-82302916949a · outbound

This paper cites Never return multiple function calls in a single response.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Never return multiple function calls in a single response

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.812548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.820654Z digest=sha256:228eb68874df9b2117d0e2d2d2b51909dedc8a73cf048ff6bb860281a1949cc3

Observation 7c9be236-8f5b-40df-910a-b6447d75970e · outbound

This paper cites The task is completed ONLY if all the intentions are fulfilled.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations The task is completed ONLY if all the intentions are fulfilled

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.792357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.826846Z digest=sha256:d761b71dc896ac359112ced8f642e58424ff9365a6790b908323e8fd19933561

Observation 68c7aa03-5380-45d0-86d7-4a24518ed800 · outbound

This paper cites In the dialogue, the user or the system could either be AI or human.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations In the dialogue, the user or the system could either be AI or human

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.771712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.833574Z digest=sha256:612352331c7a2bd2beabc90541ba8bd9aef50bbc1371cb3afa817ab54095be13

Observation f3fe30f7-8c56-459f-add3-ea87b54399db · outbound

This paper cites You should report a numeric rating from 1 to 3, where 3 represents the best coherence.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations You should report a numeric rating from 1 to 3, where 3 represents the best coherence

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.748698Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.841174Z digest=sha256:d7d57e5e039a94ef1e89488bc8f156dcc08ceac22967c88caf334035e9514633

Observation ef18a07d-f1a9-45fd-8f10-93f9246d89dc · outbound

This paper cites For dialogue-level diversity, you only need to evaluate the user.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations For dialogue-level diversity, you only need to evaluate the user

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.728888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.847118Z digest=sha256:1202396355d278ebefaae2cd9c43437cc89b0defdba6ca2a756e14a4e081c67f

Observation 4ceb158b-36f8-47c9-81fe-4f346d54fc85 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 52

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.704956Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.852987Z digest=sha256:9123516ce027b932d7bf1ddb93d8978fc0d4f078b74412994da2616887cbaacd

Observation cb0362ea-0dd5-46d6-a4cb-d6edb88e01e0 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.683535Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.859434Z digest=sha256:b020007a1b0acf14c1f83b18a11ac8d1769e8f34622b7038b96b4a122e4b33b8

Observation 4a092fcd-d86d-4475-8b77-f90ea8c25d55 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 54

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.660118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.864691Z digest=sha256:003a0ecfb744f1c8b2753b036a76bea508d0c06b564fc1621e9127c7825eb751

Observation dcecedd9-f3dd-4fe2-8acf-d1bcf955b0fb · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.630827Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.870191Z digest=sha256:8a612aaef916c90e8ca30a66a3315257cb3756cb5f1f62db1cc8664ba0b14b0f

Observation ccba7b6c-0166-40ad-9156-7dd034be9cc3 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.607919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.876084Z digest=sha256:c9d3b60f55b28c5b12913601113058eb01bc2b20bdfab31b124bd08f3f5b24c1

Observation 08c8aeac-bad8-4b99-9fae-d1ccce2b053e · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.588037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.881835Z digest=sha256:10edb9ad6ed532209a3b484e601b1c9297e8f5c229f51f5032bcda377e374ea2

Observation 26307476-c901-4cca-a601-2ae745c6384d · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 58

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.566805Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.889348Z digest=sha256:c42a42c4b76a795590bcc54a7010b7d752db8e75c2945ef6261c344c75b3ef91

Observation fcf601ce-8923-48cf-8509-0f31d7360d20 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.536473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.894397Z digest=sha256:b11f4f8f127c28dc2ac8d5517ea20b2f4c5e9a9bd7dbd8c09f0ff6c22a6884b7

Observation 53a807a2-e8e0-4315-9bf0-d569e7a195ae · outbound

This paper cites donotcare.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations donotcare

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.514855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.900560Z digest=sha256:e75299379e80b24a65e9ccab11991c8ab73866c3705242cefda9a12c1e9eba4d

Observation bcbe4ba1-8370-4040-804f-463f03d35622 · outbound

This paper cites Dialogue history is provided to understand the context better.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Dialogue history is provided to understand the context better

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.487757Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.905816Z digest=sha256:e446c82f0a17bc4ff398a04b38e387808967825a5d6edd6e3d7a800c3f9cf50e

Observation 33216a33-63b0-4a9f-afbe-bc75a9fe17aa · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 62

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.466774Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.910921Z digest=sha256:19d88cd5279391a162d7f27402ec36b271e048d23aa68668d0e7fa4de953ab44

Observation daacb79d-e931-4c82-9abb-636af78df642 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 63

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.442625Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.915875Z digest=sha256:99bebeb3b3ee64815290cf0d016e86832a97e8c477a0b0bec72366ac7f24dedf

Observation 6fee7c14-4e68-41d5-b335-4a90890516a4 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 64

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.421182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.921090Z digest=sha256:8a2d3fcfd72586b18661f8b0df424aaf19a89e620967a2869f476e0019d10645

Observation 27358541-de90-459b-88ae-57543b934739 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 66

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.399229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.932498Z digest=sha256:25e91f3e755c6e3b2381cf0ba43e0d593ec7310685c9c1c35abcd9958861d380

Observation 16d92e8e-6636-4500-bf5c-8bee7ffdcf45 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 67

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.377040Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.940850Z digest=sha256:09040547f8a6a9229115799d4b1afe845252d26985aaf6b13431cd5cb04c2f72

Observation 46490a4a-45b4-4361-b2d4-339734b1f43d · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 68

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.358564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.951647Z digest=sha256:f9db200670e656a03823bd55c1f60cb92e9a701491aed3d12a34237f08d8be6c

Observation a9d14941-4a0f-487e-887b-c2cab36f2b77 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 69

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.337299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.958834Z digest=sha256:d3116d30902e7be15801276c48389e04a9340c7b133a36bdb6517cd535cb63a8

Observation d1ce788f-bf88-4e1a-8ac2-e4cd63288316 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 70

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.312769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.966232Z digest=sha256:4272ab0b8aaaf73cb10db4a5a226b1e9de6dc53a42f9a1068633947544761ef8

Observation be36b129-bdcc-4a4a-a2a8-3bc6b95661b2 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 71

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.292363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.972973Z digest=sha256:9dfb1574390087b28517540a8df4b364dfdcf1811541a80eabce45c2fc3162a5

Observation e9264cdb-a551-4d12-914d-15a7011b5649 · outbound

This paper cites Do not infer, assume, or hallucinate values based on common patterns or prior examples.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Do not infer, assume, or hallucinate values based on common patterns or prior examples

Reference 72

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.269886Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.980091Z digest=sha256:9af77dce6198d3b5a68f81fa0c5a76557fd56fc32011a07e18c9af609682f96d

Observation 3ed15598-4dd1-44c3-8db2-d6757b6828e6 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 73

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.247730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.987963Z digest=sha256:e75b04b33c151aa540bb5fa8a6687eea01a3e788cfb210663dab168929dd17d1

Observation 8a08f849-167d-4b66-b691-f7efc88c957e · outbound

This paper cites area": ".

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations area": "

Reference 74

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.228769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.996719Z digest=sha256:525bdd02793fe63e2699f942849311acc834e0f25a52881790912c14868ccd97

Observation 3d5f2287-afab-475d-80b7-9a56b2ef5328 · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 75

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.923185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.002912Z digest=sha256:d347e58698f984bf407560ece30d054ae541121fc178cc2df68a195d2cd58b4a

Observation 2482252d-48f8-4021-9352-bbebacdfe242 · outbound

This paper cites Never respond with plain text.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Never respond with plain text

Reference 76

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.836983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.009465Z digest=sha256:f97df49e2213afd86a3c64337711a4d2c4dbfcd46e11b02ebd7a87b1a5ceabbc

Observation 717f6d3e-23cc-4578-9116-b0a4585a7b4a · outbound

This paper cites an unresolved cited work.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations Unresolved cited work

Reference 77

Resolution
unresolved
raw_fallback, observed 2026-08-15T23:08:12.210076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.015038Z digest=sha256:b954b5979316f8183eec12d8eafd785955e3ef9bcc2f6df2cd257e3c7b0b5319

Observation 868a9a4d-2155-48ea-b00e-50bbf09f2a3e · outbound

This paper cites If additional information is required to proceed, respond conversationally using direct and focused phrasing.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations If additional information is required to proceed, respond conversationally using direct and focused phrasing

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.189493Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.021994Z digest=sha256:d91eacab4ac279a1be7de752db31479559a74fb93264df13217d3dc8a54cb237

Observation 56d952e2-6119-4edb-ae33-2ee7fff44b3a · outbound

This paper cites type": "function.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations type": "function

Reference 79

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:12.168848Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:12.028546Z digest=sha256:c755933bb701821a3f97d1b6f1708b8933fb6a8a736bebdb9eab6ca605eff340

Observation 07fb300f-a7b1-4fdf-90e9-ea9af9cb7d51 · outbound

This paper cites In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2877–2888, Online.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2877–2888, Online

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T23:08:13.471681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-15T23:08:11.519127Z digest=sha256:fcbfea50be54e00b898b3d9c452032e701b67099f03c43d458f621d74060973d

Observation c983d5c9-9f91-44b9-956b-035bc07ceb5c · outbound

This paper cites User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-15T23:08:11.511635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T23:08:11.511635Z digest=sha256:df79995c5f8bf113a8d3b37aaa5b615428f411fe75a55d228d2b9bd457fe8eb6

Observation a874f7cc-db01-4b80-9b9a-23b973640b92 · outbound

This paper cites The Llama 3 Herd of Models.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations The Llama 3 Herd of Models

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-15T23:08:11.525565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T23:08:11.525565Z digest=sha256:8f3a634f574e8b26a6dc17baf7ef8764d00569407eafe80a8ae2d4ff9f7c26c6

Observation 74478500-8350-4ab8-af79-28af5d0e775e · outbound

This paper cites A Comprehensive Assessment of Dialog Evaluation Metrics.

clem:todd: A Framework for the Systematic Benchmarking of LLM-Based Task-Oriented Dialogue System Realisations A Comprehensive Assessment of Dialog Evaluation Metrics

Reference 2763

Resolution
unresolved
no resolver link, observed 2026-08-15T23:08:11.541632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T23:08:11.541632Z digest=sha256:2267619384b790b5220e6ada2f22ec8de1782dc45943a7b19ae9c8e0b65e6d12

Pith citing papers

No inbound Pith citation observations are available.