PolarQuant: Leveraging Polar Transformation for Key Cache Quantization and Decoding Acceleration

Devs

PolarQuant: Leveraging Polar Transformation for Key Cache Quantization and Decoding Acceleration | Read Paper on Bytez