Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity

Devs

Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity | Read Paper on Bytez