Pith. sign in

On the Performance of an Explainable Language Model on PubMedQA

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

Large language models (LLMs) have shown significant abilities in retrieving medical knowledge, reasoning over it and answering medical questions comparably to physicians. However, these models are not interpretable, hallucinate, are difficult to maintain and require enormous compute resources for training and inference. In this paper, we report results from Gyan, an explainable language model based on an alternative architecture, on the PubmedQA data set. The Gyan LLM is a compositional language model and the model is decoupled from knowledge. Gyan is trustable, transparent, does not hallucinate and does not require significant training or compute resources. Gyan is easily transferable across domains. Gyan-4.3 achieves SOTA results on PubmedQA with 87.1% accuracy compared to 82% by MedPrompt based on GPT-4 and 81.8% by Med-PaLM 2 (Google and DeepMind). We will be reporting results for other medical data sets - MedQA, MedMCQA, MMLU - Medicine in the future.

citation-role summary

background 1

citation-polarity summary

fields

cs.AI 1

years

2025 1

verdicts

REJECT 1

roles

background 1

polarities

support 1

representative citing papers

citing papers explorer

Showing 1 of 1 citing paper.

  • Reasoning LLMs in the Medical Domain: A Literature Survey cs.AI · 2025-08-26 · reject · none · ref 41 · internal anchor

    A literature review of reasoning-LLM techniques for medicine, from CoT prompting to RL-trained medical models, with no new experiments and several placeholder citations.