Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers

Devs

Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers | Read Paper on Bytez