Cristina Butucea · Mădălin Guţă · Michael Nussbaum·刊期 2018-12-02 · 卷 46(6B)·The Annals of Statistics已编入正刊
纯态系综与量子高斯白噪声的局部渐近等价性AI 解读
Quantum technology is increasingly relying on specialised statistical inference methods for analysing quantum measurement data. This motivates the development of “quantum statistics”, a field that is shaping up at the overlap of quantum physics and “classical” statistics. One of the less investigated topics to date is that of statistical inference for infinite dimensional quantum systems, which can be seen as quantum counterpart of nonparametric statistics. In this paper, we…
Pierre C. Bellec · Guillaume Lecué · Alexandre B. Tsybakov·刊期 2018-12-02 · 卷 46(6B)·The Annals of Statistics已编入正刊
Slope 与 Lasso:改进的预言机界及最优性AI 解读
We show that two polynomial time methods, a Lasso estimator with adaptively chosen tuning parameter and a Slope estimator, adaptively achieve the minimax prediction and $\ell_{2}$ estimation rate $(s/n)\log(p/s)$ in high-dimensional linear regression on the class of $s$-sparse vectors in $\mathbb{R}^{p}$. This is done under the Restricted Eigenvalue (RE) condition for the Lasso and under a slightly more constraining assumption on the design for the Slope. The main results…
Katharina Proksch · Frank Werner · Axel Munk·刊期 2018-12-02 · 卷 46(6B)·The Annals of Statistics已编入正刊
逆问题中的多尺度扫描AI 解读
In this paper, we propose a multiscale scanning method to determine active components of a quantity $f$ w.r.t. a dictionary $\mathcal{U}$ from observations $Y$ in an inverse regression model $Y=Tf+\xi$ with linear operator $T$ and general random error $\xi$. To this end, we provide uniform confidence statements for the coefficients $\langle\varphi,f\rangle$, $\varphi\in\mathcal{U}$, under the assumption that $(T^{*})^{-1}(\mathcal{U})$ is of wavelet-type. Based on this, we…
A bootstrap procedure for functional time series is proposed which exploits a general vector autoregressive representation of the time series of Fourier coefficients appearing in the Karhunen–Loève expansion of the functional process. A double sieve-type bootstrap method is developed, which avoids the estimation of process operators and generates functional pseudo-time series that appropriately mimics the dependence structure of the functional time series at hand. The method…
Many results have been proved for various nuclear norm penalized estimators of the uniform sampling matrix completion problem. However, most of these estimators are not robust: in most of the cases the quadratic loss function and its modifications are used. We consider robust nuclear norm penalized estimators using two well-known robust loss functions: the absolute value loss and the Huber loss. Under several conditions on the sparsity of the problem (i.e., the rank of the…
Understanding complex relationships between random variables is of fundamental importance in high-dimensional statistics, with numerous applications in biological and social sciences. Undirected graphical models are often used to represent dependencies between random variables, where an edge between two random variables is drawn if they are conditionally dependent given all the other measured variables. A large body of literature exists on methods that estimate the structure…
This article proposes a “tail-greedy”, bottom-up transform for one-dimensional data, which results in a nonlinear but conditionally orthonormal, multiscale decomposition of the data with respect to an adaptively chosen unbalanced Haar wavelet basis. The “tail-greediness” of the decomposition algorithm, whereby multiple greedy steps are taken in a single pass through the data, both enables fast computation and makes the algorithm applicable in the problem of consistent…
John Duchi · Khashayar Khosravi · Feng Ruan·刊期 2018-12-02 · 卷 46(6B)·The Annals of Statistics已编入正刊
多类别分类、信息、散度与替代风险AI 解读
We provide a unifying view of statistical information measures, multiway Bayesian hypothesis testing, loss functions for multiclass classification problems and multidistribution $f$-divergences, elaborating equivalence results between all of these objects, and extending existing results for binary outcome spaces to more general ones. We consider a generalization of $f$-divergences to multiple distributions, and we provide a constructive equivalence between divergences,…
We study recovery of piecewise-constant signals on graphs by the estimator minimizing an $l_{0}$-edge-penalized objective. Although exact minimization of this objective may be computationally intractable, we show that the same statistical risk guarantees are achieved by the $\alpha$-expansion algorithm which computes an approximate minimizer in polynomial time. We establish that for graphs with small average vertex degree, these guarantees are minimax rate-optimal over…
Statistical methods with empirical likelihood (EL) are appealing and effective especially in conjunction with estimating equations for flexibly and adaptively incorporating data information. It is known that EL approaches encounter difficulties when dealing with high-dimensional problems. To overcome the challenges, we begin our study with investigating high-dimensional EL from a new scope targeting at high-dimensional sparse model parameters. We show that the new scope…
Since its introduction in 2000, Locally Linear Embedding (LLE) has been widely applied in data science. We provide an asymptotical analysis of LLE under the manifold setup. We show that for a general manifold, asymptotically we may not obtain the Laplace–Beltrami operator, and the result may depend on nonuniform sampling unless a correct regularization is chosen. We also derive the corresponding kernel function, which indicates that LLE is not a Markov process. A comparison…
Following Baraud, Birgé and Sart [Invent. Math. 207 (2017) 425–517], we pursue our attempt to design a robust universal estimator of the joint distribution of $n$ independent (but not necessarily i.i.d.) observations for an Hellinger-type loss. Given such observations with an unknown joint distribution $\mathbf{P}$ and a dominated model $\mathscr{Q}$ for $\mathbf{P}$, we build an estimator $\widehat{\mathbf{P}}$ based on $\mathscr{Q}$ (a $\rho$-estimator) and measure its…
Alexandre Belloni · Victor Chernozhukov · Denis Chetverikov · Ying Wei·刊期 2018-12-02 · 卷 46(6B)·The Annals of Statistics已编入正刊
Z 估计框架下多函数参数的正则化后一致有效置信区域AI 解读
In this paper, we develop procedures to construct simultaneous confidence bands for ${\tilde{p}}$ potentially infinite-dimensional parameters after model selection for general moment condition models where ${\tilde{p}}$ is potentially much larger than the sample size of available data, $n$. This allows us to cover settings with functional response data where each of the ${\tilde{p}}$ parameters is a function. The procedure is based on the construction of score functions that…
Consider some multivariate diffusion process $\mathbf{X}=(X_{t})_{t\geq0}$ with unique invariant probability measure and associated invariant density $\rho$, and assume that a continuous record of observations $X^{T}=(X_{t})_{0\leq t\leq T}$ of $\mathbf{X}$ is available. Recent results on functional inequalities for symmetric Markov semigroups are used in the statistical analysis of kernel estimators $\widehat{\rho}_{T}=\widehat{\rho}_{T}(X^{T})$ of $\rho$. For the basic…
Functional data analysis on nonlinear manifolds has drawn recent interest. Sphere-valued functional data, which are encountered, for example, as movement trajectories on the surface of the earth are an important special case. We consider an intrinsic principal component analysis for smooth Riemannian manifold-valued functional data and study its asymptotic properties. Riemannian functional principal component analysis (RFPCA) is carried out by first mapping the…
Recommender systems have been widely adopted by electronic commerce and entertainment industries for individualized prediction and recommendation, which benefit consumers and improve business intelligence. In this article, we propose an innovative method, namely the recommendation engine of multilayers (REM), for tensor recommender systems. The proposed method utilizes the structure of a tensor response to integrate information from multiple modes, and creates an additional…
We propose halfspace depth concepts for scatter, concentration and shape matrices. For scatter matrices, our concept is similar to those from Chen, Gao and Ren [Robust covariance and scatter matrix estimation under Huber’s contamination model (2018)] and Zhang [J. Multivariate Anal. 82 (2002) 134–165]. Rather than focusing, as in these earlier works, on deepest scatter matrices, we thoroughly investigate the properties of the proposed depth and of the corresponding depth…
Preetam Nandy · Alain Hauser · Marloes H. Maathuis·刊期 2018-12-01 · 卷 46(6A)·The Annals of Statistics已编入正刊
基于评分及混合方法的结构学习:高维一致性AI 解读
Main approaches for learning Bayesian networks can be classified as constraint-based, score-based or hybrid methods. Although high-dimensional consistency results are available for constraint-based methods like the PC algorithm, such results have not been proved for score-based or hybrid methods, and most of the hybrid methods have not even shown to be consistent in the classical setting where the number of variables remains fixed and the sample size tends to infinity. In…
Olivier Collier · Laëtitia Comminges · Alexandre B. Tsybakov · Nicolas Verzelen·刊期 2018-12-01 · 卷 46(6A)·The Annals of Statistics已编入正刊
稀疏性约束下线性泛函的最优自适应估计AI 解读
We consider the problem of estimation of a linear functional in the Gaussian sequence model where the unknown vector $\theta \in\mathbb{R}^{d}$ belongs to a class of $s$-sparse vectors with unknown $s$. We suggest an adaptive estimator achieving a nonasymptotic rate of convergence that differs from the minimax rate at most by a logarithmic factor. We also show that this optimal adaptive rate cannot be improved when $s$ is unknown. Furthermore, we address the issue of…
We study the problem of estimating a sparse vector $\beta\in\mathbb{R}^{p}$ from the response variables $y=X\beta+w$, where $w\sim N(0,\sigma_{w}^{2}I_{n\times n})$, under the following high-dimensional asymptotic regime: given a fixed number $\delta$, $p\rightarrow\infty$, while $n/p\rightarrow\delta$. We consider the popular class of $\ell_{q}$-regularized least squares (LQLS), a.k.a. bridge estimators, given by the optimization problem \begin{equation*}\hat{\beta}(\lambda,q)\in\arg\min_{\beta}\frac{1}{2}\|y-X\beta\|_{2}^{2}+\lambda\|\beta\|_{q}^{q},\end{equation*}…
Bai Jiang · Tung-Yu Wu · Yifan Jin · Wing H. Wong·刊期 2018-12-01 · 卷 46(6A)·The Annals of Statistics已编入正刊
指数族中对比散度算法的收敛性AI 解读
The Contrastive Divergence (CD) algorithm has achieved notable success in training energy-based models including Restricted Boltzmann Machines and played a key role in the emergence of deep learning. The idea of this algorithm is to approximate the intractable term in the exact gradient of the log-likelihood function by using short Markov chain Monte Carlo (MCMC) runs. The approximate gradient is computationally-cheap but biased. Whether and why the CD algorithm provides an…
Zhidong Bai · Kwok Pui Choi · Yasunori Fujikoshi·刊期 2018-12-01 · 卷 46(6A)·The Annals of Statistics已编入正刊
基于随机矩阵理论的高维多元方差分析特征值极限行为AI 解读
In this paper, we derive the asymptotic joint distributions of the eigenvalues under the null case and the local alternative cases in the MANOVA model and multiple discriminant analysis when both the dimension and the sample size are large. Our results are obtained by random matrix theory (RMT) without assuming normality in the populations. It is worth pointing out that the null and nonnull distributions of the eigenvalues and invariant test statistics are asymptotically…
Siegfried Hörmann · Piotr Kokoszka · Gilles Nisol·刊期 2018-12-01 · 卷 46(6A)·The Annals of Statistics已编入正刊
函数型时间序列的周期性检验AI 解读
We derive several tests for the presence of a periodic component in a time series of functions. We consider both the traditional setting in which the periodic functional signal is contaminated by functional white noise, and a more general setting of a weakly dependent contaminating process. Several forms of the periodic component are considered. Our tests are motivated by the likelihood principle and fall into two broad categories, which we term multivariate and fully…
In crossover designs, each subject receives a series of treatments one after the other. Most papers on optimal crossover designs consider an estimate which is corrected for carryover effects. We look at the estimate for direct effects of treatment, which is not corrected for carryover effects. If there are carryover effects, this estimate will be biased. We try to find a design that minimizes the mean square error, that is, the sum of the squared bias and the variance. It…
We show that two polynomial time methods, a Lasso estimator with adaptively chosen tuning parameter and a Slope estimator, adaptively achieve the minimax prediction and ℓ2 estimation rate (s/n)log(p/s) in high-dimensional linear regression on the class of s-sparse vectors in Rp. This is done under the Restricted Eigenvalue (RE) condition for the Lasso and under a slightly more constraining assumption on the design for the Slope. The main results…
In this paper, we propose a multiscale scanning method to determine active components of a quantity f w.r.t. a dictionary U from observations Y in an inverse regression model Y=Tf+ξ with linear operator T and general random error ξ. To this end, we provide uniform confidence statements for the coefficients ⟨φ,f⟩, φ∈U, under the assumption that (T∗)−1(U) is of wavelet-type. Based on this, we…
We provide a unifying view of statistical information measures, multiway Bayesian hypothesis testing, loss functions for multiclass classification problems and multidistribution f-divergences, elaborating equivalence results between all of these objects, and extending existing results for binary outcome spaces to more general ones. We consider a generalization of f-divergences to multiple distributions, and we provide a constructive equivalence between divergences,…
Approximate ℓ0-penalized estimation of piecewise-constant signals on graphs
We study recovery of piecewise-constant signals on graphs by the estimator minimizing an l0-edge-penalized objective. Although exact minimization of this objective may be computationally intractable, we show that the same statistical risk guarantees are achieved by the α-expansion algorithm which computes an approximate minimizer in polynomial time. We establish that for graphs with small average vertex degree, these guarantees are minimax rate-optimal over…
Following Baraud, Birgé and Sart [Invent. Math. 207 (2017) 425–517], we pursue our attempt to design a robust universal estimator of the joint distribution of n independent (but not necessarily i.i.d.) observations for an Hellinger-type loss. Given such observations with an unknown joint distribution P and a dominated model Q for P, we build an estimator P based on Q (a ρ-estimator) and measure its…
In this paper, we develop procedures to construct simultaneous confidence bands for p~ potentially infinite-dimensional parameters after model selection for general moment condition models where p~ is potentially much larger than the sample size of available data, n. This allows us to cover settings with functional response data where each of the p~ parameters is a function. The procedure is based on the construction of score functions that…
Consider some multivariate diffusion process X=(Xt)t≥0 with unique invariant probability measure and associated invariant density ρ, and assume that a continuous record of observations XT=(Xt)0≤t≤T of X is available. Recent results on functional inequalities for symmetric Markov semigroups are used in the statistical analysis of kernel estimators ρT=ρT(XT) of ρ. For the basic…
We consider the problem of estimation of a linear functional in the Gaussian sequence model where the unknown vector θ∈Rd belongs to a class of s-sparse vectors with unknown s. We suggest an adaptive estimator achieving a nonasymptotic rate of convergence that differs from the minimax rate at most by a logarithmic factor. We also show that this optimal adaptive rate cannot be improved when s is unknown. Furthermore, we address the issue of…
We study the problem of estimating a sparse vector β∈Rp from the response variables y=Xβ+w, where w∼N(0,σw2In×n), under the following high-dimensional asymptotic regime: given a fixed number δ, p→∞, while n/p→δ. We consider the popular class of ℓq-regularized least squares (LQLS), a.k.a. bridge estimators, given by the optimization problem β^(λ,q)∈argβmin21∥y−Xβ∥22+λ∥β∥qq,…