KRAdapter, a Khatri-Rao product adapter, produces full-rank high-effective-rank weight updates for parameter-efficient fine-tuning and reports improved out-of-distribution performance over LoRA and other full-rank PEFT methods on vision-language and language benchmarks.
Zhang, Hemanth Saratchandran, Cris- tian Rodriguez-Opazo, Anton van den Hengel, and Ehsan Abbasnejad
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
method 1
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
method 1polarities
support 1representative citing papers
citing papers explorer
-
Towards Higher Effective Rank in Parameter-efficient Fine-tuning using Khatri--Rao Product
KRAdapter, a Khatri-Rao product adapter, produces full-rank high-effective-rank weight updates for parameter-efficient fine-tuning and reports improved out-of-distribution performance over LoRA and other full-rank PEFT methods on vision-language and language benchmarks.