{"arxiv_id":"2607.28048","title":"SKILL-KD: Contrastive Skill Distillation for LLM Agents","abstract":"Skill-based prompting has become a practical mechanism for improving LLM agents, yet existing methods often treat skills as summaries of the agent's own experience or of successful demonstrations. This creates a mismatch for weaker student agents. A failed trajectory may not reveal the missing knowledge or strategy, while a teacher trajectory may be too implicit to internalize. We propose SKILL-KD, a contrastive skill distillation framework that treats skills as an explicit distillation medium between agents of different capabilities. Given a student failure and the teacher trajectory on the same task, SKILL-KD distills their actionable discrepancy into a textual skill patch, evaluates it by re-running the student, and iteratively refines it when the student still fails. To prevent skill drift from repeated local updates, SKILL-KD maintains trace-linked edit histories and performs Drift-Aware Skill Consolidation to decide whether each patch is added, merged, or skipped. Across five agent benchmarks and two student settings, SKILL-KD consistently improves frozen student agents over fixed-model adaptation baselines.","primary_cat":"cs.AI","cross_cats":[],"submitted_at":"2026-07-30T11:27:37+00:00","latest_version":4,"source":"arxiv","source_label":"arXiv","source_url":null,"has_pdf":true,"has_source":false,"verdict":null,"confidence":null,"one_line_summary":null,"novelty_score":null,"correctness_risk":null,"formal_verification":null,"upvotes":0,"downvotes":0,"pith_score":0.0,"inbound_count":4,"_links":{"html":"https://pith.science/paper/2607.28048","verdict":"/api/v1/verdicts/2607.28048"}}