Pith. sign in

Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

Current medical question answering systems have difficulty processing long, detailed and informally worded questions submitted by patients, called Consumer Health Questions (CHQs). To address this issue, we introduce a medical question understanding and answering system with knowledge grounding and semantic self-supervision. Our system is a pipeline that first summarizes a long, medical, user-written question, using a supervised summarization loss. Then, our system performs a two-step retrieval to return answers. The system first matches the summarized user question with an FAQ from a trusted medical knowledge base, and then retrieves a fixed number of relevant sentences from the corresponding answer document. In the absence of labels for question matching or answer relevance, we design 3 novel, self-supervised and semantically-guided losses. We evaluate our model against two strong retrieval-based question answering baselines. Evaluators ask their own questions and rate the answers retrieved by our baselines and own system according to their relevance. They find that our system retrieves more relevant answers, while achieving speeds 20 times faster. Our self-supervised losses also help the summarizer achieve higher scores in ROUGE, as well as in human evaluation metrics. We release our code to encourage further research.

fields

cs.CL 1

years

2024 1

verdicts

CONDITIONAL 1

representative citing papers

RARE: Retrieval-Augmented Reasoning Enhancement for Large Language Models

cs.CL · 2024-12-03 · conditional · novelty 5.0

Adding retrieval-augmented actions and a retrieval-based factuality scorer to the rStar tree-search framework improves accuracy on six medical and commonsense QA benchmarks, reportedly matching or beating GPT-4o on several tasks with LLaMA 3.1 70B.

citing papers explorer

Showing 1 of 1 citing paper.

  • RARE: Retrieval-Augmented Reasoning Enhancement for Large Language Models cs.CL · 2024-12-03 · conditional · none · ref 27 · internal anchor

    Adding retrieval-augmented actions and a retrieval-based factuality scorer to the rStar tree-search framework improves accuracy on six medical and commonsense QA benchmarks, reportedly matching or beating GPT-4o on several tasks with LLaMA 3.1 70B.