Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers

Devs

Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers | Read Paper on Bytez