Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding

Devs

Gumiho: A Hybrid Architecture to Prioritize Early Tokens in Speculative Decoding | Read Paper on Bytez