On the impact of activation and normalization in obtaining isometric embeddings at initialization

Devs

On the impact of activation and normalization in obtaining isometric embeddings at initialization | Read Paper on Bytez