REVIEW 7 cited by
Beyond IID: Optimizing Instruction Learning from the Perspective of Instruction Interaction and Dependency
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
With the availability of various instruction datasets, a pivotal challenge is how to effectively select and integrate these instructions to fine-tune large language models (LLMs). Previous research mainly focuses on selecting individual high-quality instructions. However, these works overlooked the joint interactions and dependencies between different categories of instructions, leading to suboptimal selection strategies. Moreover, the nature of these interaction patterns remains largely unexplored, let alone optimize the instruction set with regard to them. To fill these gaps, in this paper, we: (1) systemically investigate interaction and dependency patterns between different categories of instructions, (2) manage to optimize the instruction set concerning the interaction patterns using a linear programming-based method, and optimize the learning schema of SFT using an instruction dependency taxonomy guided curriculum learning. Experimental results across different LLMs demonstrate improved performance over strong baselines on widely adopted benchmarks.
Forward citations
Cited by 7 Pith papers
-
SPaR: Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Models
SPaR trains LLMs by having them refine their own failed responses through tree search, producing preference pairs with minimal irrelevant variation, and lifts LLaMA3-8B above GPT-4-Turbo on IFEval.
-
Structural Entropy Guided Agent for Detecting and Repairing Knowledge Deficiencies in LLMs
SENATOR guides a language model through a knowledge graph, measures its uncertainty with structural entropy, and fine-tunes it on synthetic data chosen to fix its weak spots, gaining up to 12 percent average relative ...
-
PersonaFuse: A Personality Activation-Driven Framework for Enhancing Human-LLM Interactions
A post-training framework with persona-specific LoRA experts and a situation-aware router improves LLM emotional responses, but the evidence on preserving general ability is undercut by missing base-model comparisons.
-
Data Mixing Optimization for Supervised Fine-Tuning of Large Language Models
The authors introduce and test an optimization method for fine-tuning data mixtures that matches costly grid-search results within 0.66% validation loss.
-
Infinity Instruct: Scaling Instruction Selection and Synthesis to Enhance Language Models
A two-phase pipeline selects and synthesizes 8.9M instruction examples that, after fine-tuning, push open-source LLMs ahead of their official chat-tuned versions on both foundational and conversational benchmarks.
-
DeepDistill: Enhancing LLM Reasoning Capabilities via Large-Scale Difficulty-Graded Data Training
A two-stage SFT recipe using pass-rate and coefficient-of-variation based data selection from a 40M-response distilled dataset lifts Qwen2.5-72B to 79.2% on AIME2024, nearly matching RL-trained reasoning models.
-
Exploring the Potential of Offline RL for Reasoning in LLMs: A Preliminary Study
Applying LD-DPO to the DeepDistill-32B model improves average benchmark scores by 3.3 points, but the gains are uneven, the tables are inconsistent, and the evidence is preliminary.
Discussion (0). Continue with ORCID to comment.