Jenga: Effective Memory Management for Serving LLM with Heterogeneity

Devs

Jenga: Effective Memory Management for Serving LLM with Heterogeneity | Read Paper on Bytez