Evaluating Defences against Unsafe Feedback in RLHF | Read Paper on Bytez