Fast Training of Mixture-of-Experts for Time Series Forecasting via Expert Loss Integration
通过专家损失整合实现时间序列预测的专家混合快速训练
We propose a novel Mixture-of-Experts framework, referred to as Expert Loss Integration MoE (EliMoE), for time series forecasting. EliMoE addresses the optimization problem arising from small gating weights by incorporating expert-specific losses, which provide each expert with a direct learning signal independent of the gate-assigned weight. Specifically, the overall objective comprises the base forecasting loss and expert-specific losses, allowing individual expert…