MESS+: Dynamically Learned Inference-Time LLM Routing in Model Zoos with Service Level Guarantees

Devs

MESS+: Dynamically Learned Inference-Time LLM Routing in Model Zoos with Service Level Guarantees | Read Paper on Bytez