Collaborative Speculative Inference for Efficient LLM Inference Serving | Read Paper on Bytez

Devs

Collaborative Speculative Inference for Efficient LLM Inference Serving

3 months ago

·

arXiv