Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs

Devs

Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs | Read Paper on Bytez