REVIEW 6 cited by
Empower Large Language Model to Perform Better on Industrial Domain-Specific Question Answering
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large Language Model (LLM) has gained popularity and achieved remarkable results in open-domain tasks, but its performance in real industrial domain-specific scenarios is average due to its lack of specific domain knowledge. This issue has attracted widespread attention, but there are few relevant benchmarks available. In this paper, we provide a benchmark Question Answering (QA) dataset named MSQA, centered around Microsoft products and IT technical problems encountered by customers. This dataset contains industry cloud-specific QA knowledge, an area not extensively covered in general LLMs, making it well-suited for evaluating methods aiming to enhance LLMs' domain-specific capabilities. In addition, we propose a new model interaction paradigm that can empower LLM to achieve better performance on domain-specific tasks where it is not proficient. Extensive experiments demonstrate that the approach following our method outperforms the commonly used LLM with retrieval methods. We make our source code and sample data available at: https://aka.ms/Microsoft_QA.
Forward citations
Cited by 6 Pith papers
-
IndustryEQA: Pushing the Frontiers of Embodied Question Answering in Industrial Scenarios
IndustryEQA offers 1,344 video-based question-answer pairs across six categories, with a focus on equipment and human safety, plus evaluations of several vision-language models.
-
AdaptAgent: A Multi-agent, Domain-Guided Reasoning Framework for Code Adaptation
A multi-agent LLM pipeline that plans code adaptations using summarized intent, domain checklists, and sibling-method context outperforms single-shot prompting and repair baselines on Java adaptation examples.
-
A Collaborative Framework Integrating Large Language Model and Chemical Fragment Space: Mutual Inspiration for Lead Design
A closed-loop design framework that uses chemical fragments to guide a large language model in generating novel, high-affinity lead compounds outperformed existing de novo drug design methods.
-
KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models
A retrieval-augmented generation system that combines an entity knowledge graph and a document similarity graph to answer multi-hop questions accurately in a single retrieval pass.
-
QuIM-RAG: Advancing Retrieval-Augmented Generation with Inverted Question Matching for Enhanced QA Performance
QuIM-RAG retrieves chunks by matching a user question to LLM-generated questions from each chunk in a quantized embedding space, reporting higher QA scores than a traditional RAG baseline on an NDSU website corpus.
-
An Overview and Discussion on Using Large Language Models for Implementation Generation of Solutions to Open-Ended Problems
A survey and position paper that reviews LLM prompting, RAG, and RL techniques and argues they could support open-ended implementation generation, without presenting new results.
Discussion (0). Continue with ORCID to comment.