REVIEW 7 cited by
Knowledge Graphs as Context Sources for LLM-Based Explanations of Learning Recommendations
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
In the era of personalized education, the provision of comprehensible explanations for learning recommendations is of a great value to enhance the learner's understanding and engagement with the recommended learning content. Large language models (LLMs) and generative AI in general have recently opened new doors for generating human-like explanations, for and along learning recommendations. However, their precision is still far away from acceptable in a sensitive field like education. To harness the abilities of LLMs, while still ensuring a high level of precision towards the intent of the learners, this paper proposes an approach to utilize knowledge graphs (KG) as a source of factual context, for LLM prompts, reducing the risk of model hallucinations, and safeguarding against wrong or imprecise information, while maintaining an application-intended learning context. We utilize the semantic relations in the knowledge graph to offer curated knowledge about learning recommendations. With domain-experts in the loop, we design the explanation as a textual template, which is filled and completed by the LLM. Domain experts were integrated in the prompt engineering phase as part of a study, to ensure that explanations include information that is relevant to the learner. We evaluate our approach quantitatively using Rouge-N and Rouge-L measures, as well as qualitatively with experts and learners. Our results show an enhanced recall and precision of the generated explanations compared to those generated solely by the GPT model, with a greatly reduced risk of generating imprecise information in the final learning explanation.
Forward citations
Cited by 7 Pith papers
-
Enabling Explainable Recommendation in E-commerce with LLM-powered Product Knowledge Graph
LLM-PKG generates and prunes a product knowledge graph with LLM prompts, maps it to real inventory, and reports A/B test improvements in e-commerce recommendations.
-
Graph Foundation Models for Recommendation: A Comprehensive Survey
A comprehensive survey that categorizes graph foundation model approaches to recommendation into graph-augmented LLM, LLM-augmented graph, and LLM-graph harmonization.
-
AdaptBot: Combining LLM with Knowledge Graphs and Human Input for Generic-to-Specific Task Decomposition and Knowledge Refinement
An LLM+knowledge-graph+human-in-the-loop framework improves simulated task-completion success over LLM-only and LLM+KG baselines, though the human oracle inflates the reported gains.
-
Synergizing LLMs and Knowledge Graphs: A Novel Approach to Software Repository-Related Question Answering
An LLM plus a repository knowledge graph answers software repository questions with 84% accuracy when few-shot chain-of-thought prompting is added, outperforming an intent-based bot and web-search GPT-4o.
-
Rethinking Higher Education: From Fixed Curricula to Learnity Graphs
Learning can be represented as an evolving graph of knowledge, skills, experience, and artifacts, called a learnity graph, proposed as a basis for lifelong personalized education.
-
Position: LLMs Can be Good Tutors in English Education
A literature-based taxonomy casts LLMs as data enhancers, task predictors, and agents, arguing they can be effective tutors in English education without presenting new experiments.
-
A Comprehensive Survey on Integrating Large Language Models with Knowledge-Based Methods
A narrative review of LLM knowledge integration that categorizes techniques and compiles benchmarks, but lacks a systematic method and contains unreliable citations.
Discussion (0). Continue with ORCID to comment.