CoRM-RAG uses a cognitive perturbation protocol to simulate biases and trains an Evidence Critic to retrieve documents that support correct decisions even under adversarial query changes.
Instruction Data Selection via Answer Divergence
4 Pith papers cite this work. Polarity classification is still indexing.
4
Pith papers citing it
abstract
Instruction tuning relies on large instruction-response corpora whose quality and composition strongly affect downstream performance. We propose Answer Divergence-Guided Selection (ADG), which selects instruction data based on the geometric structure of multi-sample outputs. ADG draws several high-temperature generations per instruction, maps responses into an embedding space, and computes an output divergence score that jointly encodes dispersion magnitude and shape anisotropy. High scores correspond to instructions whose answers are both far apart and multi-modal, rather than clustered paraphrases along a single direction. Across two backbones and three public instruction pools, fine-tuning on only 10K ADG-selected examples consistently outperforms strong selectors on six benchmarks spanning reasoning, knowledge, and coding. Analyses further show that both dispersion magnitude and shape anisotropy are necessary, supporting answer divergence as a practical signal for instruction data selection. Code and appendix are included in the supplementary materials.
citation-role summary
background 2
citation-polarity summary
years
2026 4roles
background 2representative citing papers
A pipeline generates CoT traces that reduce causal hallucination in small LLMs on event causality tasks, paired with a new Causal Hallucination Rate metric that guides and validates the process.
MDS selects better multi-turn dialogues for instruction tuning by combining bin-wise global coverage with local entity-topic and format consistency scoring, outperforming prior selectors on benchmarks.
citing papers explorer
-
Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation
CoRM-RAG uses a cognitive perturbation protocol to simulate biases and trains an Evidence Critic to retrieve documents that support correct decisions even under adversarial query changes.
-
Generating Effective CoT Traces for Mitigating Causal Hallucination
A pipeline generates CoT traces that reduce causal hallucination in small LLMs on event causality tasks, paired with a new Causal Hallucination Rate metric that guides and validates the process.
-
Data Selection for Multi-turn Dialogue Instruction Tuning
MDS selects better multi-turn dialogues for instruction tuning by combining bin-wise global coverage with local entity-topic and format consistency scoring, outperforming prior selectors on benchmarks.
- Chain of Evidence: Pixel-Level Visual Attribution for Iterative Retrieval-Augmented Generation