Local geometry of high-dimensional mixture models: Effective spectral theory and dynamical transitions
高维混合模型的局部几何:有效谱理论与动力学转变
We study the local geometry of empirical risks in high dimensions via the spectral theory of their Hessian and information matrices. We focus on settings where the data, (Yℓ)ℓ=1n∈Rd, are i.i.d. draws of a k-Gaussian mixture model, and the loss depends on the projection of the data into a fixed number of vectors, namely x⊤Y, where x∈Rd×C are the parameters, and C need not equal k. This setting captures a broad class of problems such as classification by one and two-layer…