Announcement_17

[Findings of ACL 2024] Our paper “Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization” has been accepted to Findings of ACL 2024. It introduces MODPO, an RL-free extension of direct preference optimization that combines multiple alignment objectives with configurable weights.