论文检索

对《高维聚类中的重要特征主成分分析》的讨论AI 解读

We would like to congratulate the authors for an interesting paper and a novel proposal for clustering high-dimensional Gaussian mixtures with a diagonal covariance matrix.The proposed two-stage procedure first selects features based on the Kolmogorov-Smirnov statistics and then applies a spectral clustering method to the post-selected data.A rigorous theoretical analysis for the clustering error is given and the results are supported by a competitive performance in…

《高维聚类的影响特征主成分分析》讨论AI 解读

I commend Jin and Wang on a very interesting paper introducing a novel approach to feature selection within clustering and a detailed analysis of its clustering performance under a Gaussian mixture model.I shall divide my discussion into several parts: (i) prior work on feature selection and clustering; (ii) theoretical aspects; (iii) practical aspects; and finally (iv) some questions and directions for future research.On feature selection and clustering.Jin and Wang write…

摘要暂缺

We study the problem of variable selection in convex nonparametric regression. Under the assumption that the true regression function is convex and sparse, we develop a screening procedure to select a subset of variables that contains the relevant variables. Our approach is a two-stage quadratic programming method that estimates a sum of one-dimensional convex functions, followed by one-dimensional concave regression fits on the residuals. In contrast to previous methods for…

用于超高维无模型特征选择的边际切片逆回归AI 解读

Model-free variable selection has been implemented under the sufficient dimension reduction framework since the seminal paper of Cook [Ann. Statist. 32 (2004) 1062–1092]. In this paper, we extend the marginal coordinate test for sliced inverse regression (SIR) in Cook (2004) and propose a novel marginal SIR utility for the purpose of ultrahigh dimensional feature selection. Two distinct procedures, Dantzig selector and sparse precision matrix estimation, are incorporated to…

高维聚类中的重要特征主成分分析AI 解读

We consider a clustering problem where we observe feature vectors $X_{i}\in R^{p}$, $i=1,2,\ldots,n$, from $K$ possible classes. The class labels are unknown and the main interest is to estimate them. We are primarily interested in the modern regime of $p\gg n$, where classical clustering methods face challenges. We propose Influential Features PCA (IF-PCA) as a new clustering procedure. In IF-PCA, we select a small fraction of features with the largest Kolmogorov–Smirnov…

高维加性模型估计的极小极大最优收敛率AI 解读

We establish minimax optimal rates of convergence for estimation in a high dimensional additive model assuming that it is approximately sparse. Our results reveal a behavior universal to this class of high dimensional problems. In the sparse regime when the components are sufficiently smooth or the dimensionality is sufficiently large, the optimal rates are identical to those for high dimensional linear regression and, therefore, there is no additional cost to entertain a…

高维贝叶斯变量选择的计算复杂度AI 解读

We study the computational complexity of Markov chain Monte Carlo (MCMC) methods for high-dimensional Bayesian linear regression under sparsity constraints. We first show that a Bayesian approach can achieve variable-selection consistency under relatively mild conditions on the design matrix. We then demonstrate that the statistical criterion of posterior concentration need not imply the computational desideratum of rapid mixing of the MCMC algorithm. By introducing a…

非对称最小二乘回归的高维推广及其应用AI 解读

Asymmetric least squares regression is an important method that has wide applications in statistics, econometrics and finance. The existing work on asymmetric least squares only considers the traditional low dimension and large sample setting. In this paper, we systematically study the Sparse Asymmetric LEast Squares (SALES) regression under high dimensions where the penalty functions include the Lasso and nonconvex penalties. We develop a unified efficient algorithm for…

二次支撑风险下的一致模型选择准则AI 解读

In this paper, we study asymptotic properties of model selection criteria for high-dimensional regression models where the number of covariates is much larger than the sample size. In particular, we consider a class of loss functions called the class of quadratically supported risks which is large enough to include the quadratic loss, Huber loss, quantile loss and logistic loss. We provide sufficient conditions for the model selection criteria, which are applicable to the…

使用全局—局部收缩先验的默认贝叶斯分析AI 解读

We provide a framework for assessing the default nature of a prior distribution using the property of regular variation, which we study for global-local shrinkage priors. In particular, we show that the horseshoe priors, originally designed to handle sparsity, are regularly varying and thus are appropriate for default Bayesian analysis. To illustrate our methodology, we discuss four problems of noninformative priors that have been shown to be highly informative for nonlinear…

准稀疏计数数据的贝叶斯推断AI 解读

There is growing interest in analysing high-dimensional count data, which often exhibit quasi-sparsity corresponding to an overabundance of zeros and small nonzero counts. Existing methods for analysing multivariate count data via Poisson or negative binomial log-linear hierarchical models with zero-inflation cannot flexibly adapt to quasi-sparse settings. We develop a new class of continuous local-global shrinkage priors tailored to quasi-sparse counts. Theoretical…

高维带状向量自回归模型AI 解读

We consider a class of vector autoregressive models with banded coefficient matrices. This setting represents a type of sparse structure for high-dimensional time series, although the implied auto-covariance matrices are not banded. The structure is also practically meaningful when the component time series are ordered appropriately. We establish the convergence rates of the estimated banded autoregressive coefficient matrices. We also propose a Bayesian information…

高维回归中高斯尺度混合先验的快速抽样AI 解读

We propose an efficient way to sample from a class of structured multivariate Gaussian distributions. The proposed algorithm only requires matrix multiplications and linear system solutions. Its computational complexity grows linearly with the dimension, unlike existing algorithms that rely on Cholesky factorizations with cubic complexity. The algorithm is broadly applicable in settings where Gaussian scale mixture priors are used on high-dimensional parameters. Its…

不可忽略无应答下的模型选择AI 解读

Existing methods for handling nonignorable missing data rely on the correct specification of parametric models, which is difficult to check. By utilizing the information carried in an instrument, we propose a novel model selection criterion, called the penalized validation criterion, in the presence of nonignorable nonresponse with unspecified propensity. The proposed method can consistently select the most compact correct parametric model from a group of candidate models if…

多重结构变化回归模型的收缩估计AI 解读

In this paper, we consider the problem of determining the number of structural changes in multiple linear regression models via group fused Lasso. We show that with probability tending to one, our method can correctly determine the unknown number of breaks, and the estimated break dates are sufficiently close to the true break dates. We obtain estimates of the regression coefficients via post Lasso and establish the asymptotic distributions of the estimates of both break…

基于加性条件独立的变量选择AI 解读

Summary We propose a non-parametric variable selection method which does not rely on any regression model or predictor distribution. The method is based on a new statistical relationship, called additive conditional independence, that has been introduced recently for graphical models. Unlike most existing variable selection methods, which target the mean of the response, the method proposed targets a set of attributes of the response, such as its mean, variance or entire…

高维广义线性模型的检验AI 解读

Summary We consider testing regression coefficients in high dimensional generalized linear models. By modifying the test statistic of Goeman and his colleagues for large but fixed dimensional settings, we propose a new test, based on an asymptotic analysis, that is applicable for diverging dimensions and is robust to accommodate a wide range of link functions. The power properties of the tests are evaluated asymptotically under two families of alternative hypotheses. In…

具有高维矩等式的计量经济学估计AI 解读

We consider a nonlinear structural model in which the number of moments is not limited by the sample size. The econometric problem here is to estimate and perform inference on a finite-dimensional parameter. To handle the high dimensionality, we must systematically choose a set of informative moments; in other words, delete the uninformative ones. In nonlinear models, a consistent estimator is a prerequisite for moment selection. We develop in this paper a novel two-step…

高维相关随机效应面板模型中的预言不等式、变量选择与一致有效推断AI 解读

In this paper we study high-dimensional correlated random effects panel data models. Our setting is useful as it allows including time invariant covariates as under random effects yet allows for correlation between covariates and unobserved heterogeneity as under fixed effects. We use the Mundlak–Chamberlain device to model this correlation. Allowing for a flexible correlation structure naturally leads to a high-dimensional model in which least squares estimation easily…

高维线性模型中单个回归系数的检验AI 解读

In linear regression models with high dimensional data, the classical z-test (or t-test) for testing the significance of each single regression coefficient is no longer applicable. This is mainly because the number of covariates exceeds the sample size. In this paper, we propose a simple and novel alternative by introducing the Correlated Predictors Screening (CPS) method to control for predictors that are highly correlated with the target covariate. Accordingly, the…

一般平滑模型的平滑参数与模型选择AI 解读

This article discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be present. By construction the method is numerically stable and convergent, and enables smoothing parameter uncertainty to be quantified. The latter enables us to fix a well known problem with AIC for such models, thereby improving the range of…

融合已知与新生物信息的层级特征选择：识别前列腺癌复发相关基因组特征AI 解读

Our work is motivated by a prostate cancer study aimed at identifying mRNA and miRNA biomarkers that are predictive of cancer recurrence after prostatectomy. It has been shown in the literature that incorporating known biological information on pathway memberships and interactions among biomarkers improves feature selection of high-dimensional biomarkers in relation to disease risk. Biological information is often represented by graphs or networks, in which biomarkers are…

含交互固定效应与多重结构突变的面板数据模型AI 解读

In this article, we consider estimation of common structural breaks in panel data models with unobservable interactive fixed effects. We introduce a penalized principal component (PPC) estimation procedure with an adaptive group fused LASSO to detect the multiple structural breaks in the models. Under some mild conditions, we show that with probability approaching one the proposed method can correctly determine the unknown number of breaks and consistently estimate the…