HydraOpt merges K LoRA adapters into one shared A' and M task-specific B' matrices, yielding a storage-performance curve that outperforms TA, TIES, DARE, and DARE-TIES once storage rises modestly above 20%.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
HydraOpt: Navigating the Efficiency-Performance Trade-off of Adapter Merging
HydraOpt merges K LoRA adapters into one shared A' and M task-specific B' matrices, yielding a storage-performance curve that outperforms TA, TIES, DARE, and DARE-TIES once storage rises modestly above 20%.