Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts | Bytez

b

DiscoverModelsSearch

Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts

1 week ago

·

NeurIPS