A new structured prompting method (SPEC) helps AI detect insufficient evidence in adjudication tasks and defer decisions appropriately, reaching 89% accuracy on a benchmark varying information completeness from Colorado unemployment insurance cases.
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems , pages =
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
citation-role summary
background 1
citation-polarity summary
years
2026 2verdicts
UNVERDICTED 2roles
background 1polarities
background 1representative citing papers
The paper introduces a foundational framework with definition, architecture, and processes for effective human oversight of AI systems, plus a documentation template and open research challenges.
citing papers explorer
-
Learning When Not to Decide: A Framework for Overcoming Factual Presumptuousness in AI Adjudication
A new structured prompting method (SPEC) helps AI detect insufficient evidence in adjudication tasks and defer decisions appropriately, reaching 89% accuracy on a benchmark varying information completeness from Colorado unemployment insurance cases.
-
Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
The paper introduces a foundational framework with definition, architecture, and processes for effective human oversight of AI systems, plus a documentation template and open research challenges.