A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO | Read Paper on Bytez