SharedRep-RLHF learns a shared preference representation across groups to improve worst-case reward estimates for minority annotators, but the theoretical guarantees are undermined by proof errors.
A Sharp Fannes-type Inequality for the von Neumann Entropy
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
We derive an inequality relating the entropy difference between two quantum states to their trace norm distance, sharpening a well-known inequality due to M. Fannes. In our inequality, equality can be attained for every prescribed value of the trace norm distance.
citation-role summary
method 1
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
REJECT 1roles
method 1polarities
use method 1representative citing papers
citing papers explorer
-
SharedRep-RLHF: A Shared Representation Approach to RLHF with Diverse Preferences
SharedRep-RLHF learns a shared preference representation across groups to improve worst-case reward estimates for minority annotators, but the theoretical guarantees are undermined by proof errors.