BlockDialect: Block-wise Fine-grained Mixed Format Quantization for Energy-Efficient LLM Inference

Devs

BlockDialect: Block-wise Fine-grained Mixed Format Quantization for Energy-Efficient LLM Inference | Read Paper on Bytez