Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization

Devs

Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization | Read Paper on Bytez