REVIEW 8 cited by
Faithful Reasoning Using Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Although contemporary large language models (LMs) demonstrate impressive question-answering capabilities, their answers are typically the product of a single call to the model. This entails an unwelcome degree of opacity and compromises performance, especially on problems that are inherently multi-step. To address these limitations, we show how LMs can be made to perform faithful multi-step reasoning via a process whose causal structure mirrors the underlying logical structure of the problem. Our approach works by chaining together reasoning steps, where each step results from calls to two fine-tuned LMs, one for selection and one for inference, to produce a valid reasoning trace. Our method carries out a beam search through the space of reasoning traces to improve reasoning quality. We demonstrate the effectiveness of our model on multi-step logical deduction and scientific question-answering, showing that it outperforms baselines on final answer accuracy, and generates humanly interpretable reasoning traces whose validity can be checked by the user.
Forward citations
Cited by 8 Pith papers
-
HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models
Hallucinated captions systematically improve VLM accuracy on vision-language tasks across nine models and nine datasets, with gains linked to broadened semantic coverage and modulated reasoning entropy.
-
Human-Like Code Quality Evaluation through LLM-based Recursive Semantic Comprehension
HuCoSC scores generated code by recursively decomposing code into sub-blocks, storing dependency semantics, and using an LLM to compare the semantic descriptions of reference and generated code.
-
Finetuning Lightweight LLMs for Control Flow Graph Generation
Fine-tuned ~3–7B LLMs generate unified digraph CFGs from incomplete/erroneous code and show partial cross-language transfer to held-out JavaScript.
-
Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety
A new survey organizes LLM interpretation methods by workflow stage and connects them to safety enhancement strategies and tools, covering around 70 works.
-
An Analysis for Reasoning Bias of Language Models with Small Initialization
Initialization scale controls whether a transformer learns compositional reasoning or memorized mappings, because reasoning tokens acquire more differentiated embeddings early in training.
-
Standardizing Intelligence: Aligning Generative AI for Regulatory and Operational Compliance
The paper proposes C3F, a two-axis framework rating GenAI compliance capability and standard criticality, and applies it to 15 models and 34 standards.
-
Two-way Evidence self-Alignment based Dual-Gated Reasoning Enhancement
ESA-DGR combines two-way evidence self-alignment with dual-gated knowledge fusion and GRPO training to improve multi-hop question answering on HotpotQA, 2WikiMultiHopQA, and MuSiQue.
-
Mechanistic Unveiling of Transformer Circuits: Self-Influence as a Key to Model Reasoning
SICAF traces per-token self-influence inside extracted circuits to map GPT-2's reasoning on the IOI task.
Discussion (0). Continue with ORCID to comment.