REVIEW 5 cited by
Factuality of Large Language Models: A Survey
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a straightforward answer to a variety of questions in a single place. Unfortunately, in many cases, LLM responses are factually incorrect, which limits their applicability in real-world scenarios. As a result, research on evaluating and improving the factuality of LLMs has attracted a lot of attention recently. In this survey, we critically analyze existing work with the aim to identify the major challenges and their associated causes, pointing out to potential solutions for improving the factuality of LLMs, and analyzing the obstacles to automated factuality evaluation for open-ended text generation. We further offer an outlook on where future research should go.
Forward citations
Cited by 5 Pith papers
-
Conversational AI as a Catalyst for Informal Learning: An Empirical Large-Scale Study on LLM Use in Everyday Learning
Most adults in a German Prolific sample report using large language models for informal learning, with four distinct learner profiles emerging from their usage patterns.
-
Eliciting Language Model Behaviors with Investigator Agents
Investigator models trained with an iterative Frank-Wolfe objective discover diverse, interpretable natural-language prompts that elicit targeted jailbreaks, hallucinations, and aberrant behaviors.
-
International Security Applications of Flexible Hardware-Enabled Guarantees
A policy report argues that hardware-level guarantees on AI chips could make international AI governance agreements stable if states value winning only modestly and fear catastrophe sufficiently.
-
AssertBench: A Benchmark for Evaluating Self-Assertion in Large Language Models
AssertBench measures how often LLMs keep the same true/false evaluation of a fact across contradictory user framings, and finds most tested models agree with the user's framing more when they do not know the fact.
-
Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making
The paper proposes an LLM-based agent as a natural-language bridge to simulation models, but it reports no implementation or evaluation.
Discussion (0). Continue with ORCID to comment.