From Condensation to Rank Collapse: A Two-Stage Analysis of Transformer Training Dynamics

Devs

From Condensation to Rank Collapse: A Two-Stage Analysis of Transformer Training Dynamics | Read Paper on Bytez