Distortion of AI Alignment: Does Preference Optimization Optimize for Preferences?

Devs

Distortion of AI Alignment: Does Preference Optimization Optimize for Preferences? | Read Paper on Bytez