MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding

Devs

MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding | Read Paper on Bytez