OmniDraft: A cross-vocabulary, online adaptive drafter for on-device speculative decoding

Devs

OmniDraft: A cross-vocabulary, online adaptive drafter for on-device speculative decoding | Read Paper on Bytez