REVIEW 14 cited by
Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Bases
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We proposed an end-to-end system design towards utilizing Retrieval Augmented Generation (RAG) to improve the factual accuracy of Large Language Models (LLMs) for domain-specific and time-sensitive queries related to private knowledge-bases. Our system integrates RAG pipeline with upstream datasets processing and downstream performance evaluation. Addressing the challenge of LLM hallucinations, we finetune models with a curated dataset which originates from CMU's extensive resources and annotated with the teacher model. Our experiments demonstrate the system's effectiveness in generating more accurate answers to domain-specific and time-sensitive inquiries. The results also revealed the limitations of fine-tuning LLMs with small-scale and skewed datasets. This research highlights the potential of RAG systems in augmenting LLMs with external datasets for improved performance in knowledge-intensive tasks. Our code and models are available on Github.
Forward citations
Cited by 14 Pith papers
-
DRAGged into Conflicts: Detecting and Addressing Conflicting Sources in Search-Augmented LLMs
The paper introduces a taxonomy and benchmark for knowledge conflicts in search-augmented LLMs, and experiments show that prompting for conflict type improves response quality.
-
Quasiparticle interference in LiFeAs: Signature of inelastic tunneling through spin fluctuations
Replica QPI features in LiFeAs are attributed to inelastic tunneling through spin fluctuations at 8 to 10 meV, matching neutron scattering.
-
From Sufficiency to Reflection: Reinforcement-Guided Thinking Quality in Retrieval-Augmented Reasoning for LLMs
TIRESRAG-R1 trains RAG models with sufficiency, thinking, and reflection rewards plus difficulty-aware reweighting, improving multi-hop QA accuracy.
-
EraRAG: Efficient and Incremental Retrieval Augmented Generation for Growing Corpora
EraRAG uses hyperplane-based locality-sensitive hashing to build a hierarchical retrieval graph whose affected regions only are re-summarized when new documents arrive, cutting update cost by up to an order of magnitude.
-
MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability
A pre-training task called RAMP, where models practice searching to fill masked text spans, improves downstream agentic open-domain QA performance across Qwen and LLaMA models.
-
Novobo: Supporting Teachers' Peer Learning of Instructional Gestures by Teaching a Mentee AI-Agent Together
Novobo, a teachable AI agent that acts as an apprentice teacher, helped 30 teachers in 10 sessions externalize and co-construct knowledge about instructional gestures through group discussion and embodied demonstration.
-
Integrating Rules and Semantics for LLM-Based C-to-Rust Translation
IRENE combines rule-based retrieval, structured summarization, and compiler feedback to improve LLM-based C-to-Rust translation accuracy and safety.
-
DeRAG: Black-box Adversarial Attacks on Multiple Retrieval-Augmented Generation Applications via Prompt Injection
DeRAG shows that five or fewer tokens found by differential evolution can make black-box RAG retrievers rank a chosen wrong document near the top on small BEIR subsets.
-
Context-Aware Search and Retrieval Over Erasure Channels
A bivariate Gaussian approximation yields a formula for the retrieval error probability in two-document TF-IDF search over an erasure channel with repetition coding.
-
LLM-Assisted Question-Answering on Technical Documents Using Structured Data-Aware Retrieval Augmented Generation
A RAG pipeline with OCR, table and image to text conversion, and a RAFT-tuned reranker reports high QA scores, but its 50-question evaluation overlaps with its training manuals and its baseline comparison uses only 5 ...
-
Fine-Tuning and Prompt Engineering of LLMs, for the Creation of Multi-Agent AI for Addressing Sustainable Protein Production Challenges
A proof-of-concept multi-agent GPT system for microbial protein literature extraction shows both fine-tuning and prompt engineering improve cosine-similarity scores, with fine-tuning slightly ahead but more variable.
-
Continually Self-Improving Language Models for Bariatric Surgery Question--Answering
bRAGgen uses a perplexity threshold to trigger web retrieval and LoRA fine-tuning, improving answers on a new bariatric surgery QA dataset, but the evaluation is confounded by test-time adaptation.
-
A Survey on Proactive Defense Strategies Against Misinformation in Large Language Models
A survey claims proactive defenses against LLM misinformation outperform post-hoc detection by up to 63%, but no meta-analysis details are provided to support the claim.
-
Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges
A review that classifies Reasoning Agentic RAG into predefined (System 1-like) and agentic (System 2-like) workflows, surveying their designs and training strategies.
Discussion (0). Sign in to comment.