FlowMoE: A Scalable Pipeline Scheduling Framework for Distributed Mixture-of-Experts Training

Devs

FlowMoE: A Scalable Pipeline Scheduling Framework for Distributed Mixture-of-Experts Training | Read Paper on Bytez