The underlying structures of self-attention: symmetry, directionality, and emergent dynamics in Transformer training

Devs

The underlying structures of self-attention: symmetry, directionality, and emergent dynamics in Transformer training | Read Paper on Bytez