ADOPT: Modified Adam Can Converge with Any $\beta_2$ with the Optimal Rate

Devs

ADOPT: Modified Adam Can Converge with Any $\beta_2$ with the Optimal Rate | Read Paper on Bytez