Understanding the Logic of Direct Preference Alignment through Logic | Read Paper on Bytez