REVIEW 5 cited by
SAIL: Search-Augmented Instruction Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Large language models (LLMs) have been significantly improved by instruction fine-tuning, but still lack transparency and the ability to utilize up-to-date knowledge and information. In this work, we propose search-augmented instruction learning (SAIL), which grounds the language generation and instruction following abilities on complex search results generated by in-house and external search engines. With an instruction tuning corpus, we collect search results for each training case from different search APIs and domains, and construct a new search-grounded training set containing \textit{(instruction, grounding information, response)} triplets. We then fine-tune the LLaMA-7B model on the constructed training set. Since the collected results contain unrelated and disputing languages, the model needs to learn to ground on trustworthy search results, filter out distracting passages, and generate the target response. The search result-denoising process entails explicit trustworthy information selection and multi-hop reasoning, since the retrieved passages might be informative but not contain the instruction-following answer. Experiments show that the fine-tuned SAIL-7B model has a strong instruction-following ability, and it performs significantly better on transparency-sensitive tasks, including open-ended question answering and fact checking.
Forward citations
Cited by 5 Pith papers
-
MAGNET: A Multi-agent Framework for Finding Audio-Visual Needles by Reasoning over Multi-Video Haystacks
AVHaystacks is a new 3100-question benchmark for audio-visual QA across 500 videos, and the MAGNET multi-agent pipeline beats current baselines on it.
-
Toward Structured Knowledge Reasoning: Contrastive Retrieval-Augmented Generation on Experience
CoRE improves structured knowledge reasoning by retrieving both correct and incorrect past examples into the prompt, using MCTS-generated experience memory.
-
Alignment-Augmented Speculative Decoding with Alignment Sampling and Conditional Verification
AASD combines alignment sampling from the prefilling distribution with entropy-based conditional verification to improve both the accuracy and speed of retrieval-based speculative decoding.
-
Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processes
The paper reports that a fact-checker trained on replaced entities, used both as a reward and as the evaluation metric, raises measured step-factuality of small open LLMs by up to 49.9 percentage points.
-
Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ Documents
Introduces DocHaystack and InfoHaystack, 1000-document visual retrieval benchmarks, and V-RAG, an ensemble-plus-filter RAG method that improves Recall@1 by 9 and 11 points over prior baselines.
Discussion (0). Continue with ORCID to comment.