ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification

Devs

ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification | Read Paper on Bytez