Adding an extra 'Unknown' option to True/False prompts causes LLMs to abstain on questions they can answer, and random words reproduce the effect, indicating abstention is partly a prompt artifact.
Its gold label set also includes Unknown (for conclusions neither true nor false given the premises)
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
LLM Abstention Can Be a Prompt Artifact, in Addition to Genuine Uncertainty
Adding an extra 'Unknown' option to True/False prompts causes LLMs to abstain on questions they can answer, and random words reproduce the effect, indicating abstention is partly a prompt artifact.