SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization

Devs

SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization | Read Paper on Bytez