Adam with model exponential moving average is effective for nonconvex optimization

Devs

Adam with model exponential moving average is effective for nonconvex optimization | Read Paper on Bytez