ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals

Devs

ResQ: Mixed-Precision Quantization of Large Language Models with Low-Rank Residuals | Read Paper on Bytez