Pith. sign in

REVIEW 6 cited by

Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2310.14696 v1 pith:EAAMIOJK submitted 2023-10-23 cs.CL

Gangwoo Kim , Sungdong Kim , Byeongguk Jeon , Joonsuk Park , Jaewoo Kang This is my paper · ORCID
classification cs.CL
keywords ambiguoustreeansweransweringbaselineschallengeclarificationsfew-shot
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Questions in open-domain question answering are often ambiguous, allowing multiple interpretations. One approach to handling them is to identify all possible interpretations of the ambiguous question (AQ) and to generate a long-form answer addressing them all, as suggested by Stelmakh et al., (2022). While it provides a comprehensive response without bothering the user for clarification, considering multiple dimensions of ambiguity and gathering corresponding knowledge remains a challenge. To cope with the challenge, we propose a novel framework, Tree of Clarifications (ToC): It recursively constructs a tree of disambiguations for the AQ -- via few-shot prompting leveraging external knowledge -- and uses it to generate a long-form answer. ToC outperforms existing baselines on ASQA in a few-shot setup across the metrics, while surpassing fully-supervised baselines trained on the whole training set in terms of Disambig-F1 and Disambig-ROUGE. Code is available at https://github.com/gankim/tree-of-clarifications.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. HedraRAG: Coordinating LLM Generation and Database Retrieval in Heterogeneous RAG Serving

    cs.DB 2025-07 conditional novelty 6.0 of 10

    HedraRAG uses a graph abstraction and dynamic transformations to pipeline generation and retrieval stages, achieving 1.5x to 5x speedups in heterogeneous RAG serving.

  2. IC-Cache: Efficient Large Language Model Serving via In-context Caching

    cs.LG 2025-01 conditional novelty 6.0 of 10

    IC-Cache reuses historical large-model responses as in-context examples so small models can handle a larger share of serving traffic without losing quality, improving throughput and latency.

  3. Acknowledging Focus Ambiguity in Visual Questions

    cs.CV 2025-01 conditional novelty 6.0 of 10

    VQ-FocusAmbiguity is a 5,500-example dataset annotating all plausible focus regions for visual questions, and state-of-the-art models perform poorly at recognizing and locating focus ambiguity.

  4. Federated In-Context LLM Agent Learning

    cs.LG 2024-12 reject novelty 5.0 of 10

    FICAL shares tool-usage text summaries instead of model weights in federated LLM agent learning, reporting similar accuracy with far less communication, but the evidence is incomplete.

  5. Thinking About Thinking: SAGE-nano's Inverse Reasoning for Self-Aware Language Models

    cs.AI 2025-06 reject novelty 3.0 of 10

    A 4B-parameter model is claimed to explain its own reasoning through inverse attention analysis, but the paper offers no consistent evidence or artifacts.

  6. A Survey on Large Language Models with some Insights on their Capabilities and Limitations

    cs.CL 2025-01 unverdicted novelty 3.0 of 10

    A broad survey of LLM methods and applications, plus an empirical section on how code-rich pretraining may influence chain-of-thought reasoning, the details of which are not visible in the supplied text.

Pith tools