Speculative Prefill: Turbocharging TTFT with Lightweight and Training-Free Token Importance Estimation

Devs

Speculative Prefill: Turbocharging TTFT with Lightweight and Training-Free Token Importance Estimation | Read Paper on Bytez