Transformers learn to implement preconditioned gradient descent for in-context learning

Devs

Transformers learn to implement preconditioned gradient descent for in-context learning | Read Paper on Bytez