Adaptive margins for DPO inferred from preference-over-preference comparisons improve alignment quality, with random sampling of comparisons working best overall.
Title resolution pending
1 Pith paper cite this work, alongside 44 external citations. Polarity classification is still indexing.
1
Pith paper citing it
44
external citations · OpenAlex
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Adaptive Margin RLHF via Preference over Preferences
Adaptive margins for DPO inferred from preference-over-preference comparisons improve alignment quality, with random sampling of comparisons working best overall.