Revisiting Incremental Stochastic Majorization-Minimization Algorithms with Applications to Mixture of Experts
重新审视增量随机主化最小化算法及其在专家混合模型中的应用
Processing high-volume, streaming data is increasingly common in modern statistics and machine learning, where batch-mode algorithms are often impractical because they require repeated passes over the full dataset. This has motivated incremental stochastic estimation methods, including the incremental stochastic Expectation-Maximization (EM) algorithm formulated via stochastic approximation. In this work, we revisit and analyze an incremental stochastic variant of the…