论文检索

统计研究的新兴知识趋势：协变量辅助动态主题模型分析AI 解读

Exploring the emerging knowledge trends within a particular discipline is of great interest to scientific researchers. It helps researchers to understand the historical development of their disciplines and to guide their future research directions. In this work, we focus on the fast-developing discipline, statistics, to investigate its knowledge trend and emerging topics in statistical research. To this end, we collect publications in top-tier statistical journals and…

基于卷积平滑支持向量机的去中心化网络高效分布式学习AI 解读

This article concerns efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double nonsmoothness of the objective function poses significant challenges in developing efficient decentralized learning methods. Existing approaches frequently suffer from slow, sublinear convergence rates. To address this issue, we consider a convolution-based…

高维一般学习程序的拟合优度评估AI 解读

Black-box learners have demonstrated remarkable success across various fields due to their high predictive accuracy. However, the complexity of their learning procedures poses significant challenges in evaluating whether a given learner has achieved optimal performance on datasets with unknown data-generating mechanisms. We propose a general goodness-of-fit test for assessing different learning procedures involving high-dimensional predictors, encompassing methods from…

高维卷积秩回归的统计推断AI 解读

High-dimensional penalized rank regression is a powerful tool for modeling high-dimensional data due to its robustness and estimation efficiency. However, the non-smoothness of the rank loss brings great challenges to the computation. To solve this critical issue, high-dimensional convoluted rank regression has been recently proposed, introducing penalized convoluted rank regression estimators. However, these developed estimators cannot be directly used to make inference. In…

均值泛函估计的改进分治方法及其平均处理效应应用AI 解读

Mean estimation is an important issue in statistical inference and machine learning. We are concerned with estimating mean functional that is a function of several nonparametric functions when there is a large amount of observations. Directly estimating such mean functional through nonparametric smoothing has the complexity of at least a quadratic order of the sample size, which is computationally prohibitive for massive data. The divide-and-conquer approach are thus readily…

区间分位数相关及高维分位数效应检验AI 解读

In this article, we propose interval quantile correlation and interval quantile partial correlation to measure the association between two random variables over an interval of quantile levels. We construct efficient estimators for the proposed correlations, and establish their asymptotic properties under the null and alternative hypotheses. We further use the interval quantile partial correlation to test for the significance of covariate effects in high-dimensional quantile…

高维投影独立性检验：难题与改进AI 解读

Summary Testing independence between high-dimensional random vectors is fundamentally different from testing independence between univariate random variables. Taking the projection correlation as an example, it suffers from at least three problems. First, it has a high computational complexity of O{n3(p+q)}, where n, p and q are the sample size and dimensions of the random vectors; this limits its usefulness substantially when n is extremely large. Second, the asymptotic…

基于互信息检验无条件与条件独立性AI 解读

Testing independence has garnered increasing attention in the econometric and statistical literature. Many tests have been proposed, most of which are inconsistent against all departures from independence. Few of those tests, though consistent, suffer a significant loss of local power. This study proposes a mutual information test for testing independence. The proposed test is simple to implement and, with a slight loss of local power, is consistent against all departures…

利用秩指标检验两个高维向量的独立性AI 解读

To test independence between two high-dimensional random vectors, we propose three tests based on the rank-based indices derived from Hoeffding’s D, Blum–Kiefer–Rosenblatt’s R and Bergsma–Dassios–Yanagimoto’s τ∗. Under the null hypothesis of independence, we show that the distributions of the proposed test statistics converge to normal ones if the dimensions diverge arbitrarily with the sample size. We further derive an explicit rate of convergence. Thanks to the monotone…

超高维数据筛选后的诊断检验AI 解读

We propose a consistent lack-of-fit test to assess whether replacing the original ultrahigh dimensional covariates with a given number of linear combinations results in a loss of regression information. To attenuate the spurious correlations that may inflate type-I error rates in high dimensions, we suggest to randomly split the observations into two parts. In the first part, we screen out as many irrelevant covariates as possible. This screening step helps to reduce the…

通过聚合累积协方差检验高维协变量的影响AI 解读

In this article, we test for the effects of high-dimensional covariates on the response. In many applications, different components of covariates usually exhibit various levels of variation, which is ubiquitous in high-dimensional data. To simultaneously accommodate such heteroscedasticity and high dimensionality, we propose a novel test based on an aggregation of the marginal cumulative covariances, requiring no prior information on the specific form of regression models.…

区间响应的特征筛选：招聘工资与技能要求的关联AI 解读

It is important to quantify the differences in returns to skills using the online job advertisements data, which have attracted great interest in both labor economics and statistics fields. In this paper, we study the relationship between the posted salary and the job requirements in online labor markets. There are two challenges to deal with. First, the posted salary is always presented in an interval-valued form, for example, 5k-10k yuan per month. Simply taking the…

依赖过程条件独立检验的投影方法AI 解读

Conditional independence is a fundamental concept in many scientific fields. In this article, we propose a projective approach to measuring and testing departure from conditional independence for dependent processes. Through projecting high-dimensional dependent processes on to low-dimensional subspaces, our proposed projective approach is insensitive to the dimensions of the processes. We show that, under the common β-mixing conditions, our proposed projective test…

基于稀疏充分降维的稳健高效因果推断AI 解读

A fundamental assumption used in causal inference with observational data is that treatment assignment is ignorable given measured confounding variables. This assumption of no missing confounders is plausible if a large number of baseline covariates are included in the analysis, as we often have no prior knowledge of which variables can be important confounders. Thus, estimation of treatment effects with a large number of covariates has received considerable attention in…

区间分位数依赖的度量与检验AI 解读

In this article, we introduce the notion of interval quantile independence which generalizes the notions of statistical independence and quantile independence. We suggest an index to measure and test departure from interval quantile independence. The proposed index is invariant to monotone transformations, nonnegative and equals zero if and only if the interval quantile independence holds true. We suggest a moment estimate to implement the test. The resultant estimator is…

两个随机向量之间的投影相关AI 解读

We propose the use of projection correlation to characterize dependence between two random vectors. Projection correlation has several appealing properties. It equals zero if and only if the two random vectors are independent, it is not sensitive to the dimensions of the two random vectors, it is invariant with respect to the group of orthogonal transformations, and its estimation is free of tuning parameters and does not require moment conditions on the random vectors. We…

Sufficient dimension reduction has been extensively explored in the context of independent and identically distributed data. In this article we generalize sufficient dimension reduction to longitudinal data and propose an estimating equation approach to estimating the central mean subspace. The proposed method accounts for the covariance structure within each subject and improves estimation efficiency when the covariance structure is correctly specified. Even if the…

分位数回归中变系数的估计与检验AI 解读

In this article, we establish a novel connection between the null hypothesis H0 on the coefficients and a rank-reducible form of the varying coefficient model in quantile regression. We use B-splines to approximate the varying coefficients in the rank-reducible model, and make use of the fact that the null hypothesis H0 implies a unidimensional structure of a transformed coefficient matrix for the B-spline basis functions. By evaluating the unidimensional structure, we…

中心均值子空间的估计效率AI 解读

Summary We investigate the estimation efficiency of the central mean subspace in the framework of sufficient dimension reduction. We derive the semiparametric efficient score and study its practical applicability. Despite the difficulty caused by the potential high dimension issue in the variance component, we show that locally efficient estimators can be constructed in practice. We conduct simulation studies and a real data analysis to demonstrate the finite sample…

允许高维协变量的异方差部分线性单指标模型：双重稳健与有效估计AI 解读

Summary We study the heteroscedastic partially linear single-index model with an unspecified error variance function, which allows for high dimensional covariates in both the linear and the single-index components of the mean function. We propose a class of consistent estimators of the parameters by using a proper weighting strategy. An interesting finding is that the linearity condition which is widely assumed in the dimension reduction literature is not necessary for…

充分降维中的有效估计AI 解读

We develop an efficient estimation procedure for identifying and estimating the central subspace. Using a new way of parameterization, we convert the problem of identifying the central subspace to the problem of estimating a finite dimensional parameter in a semiparametric model. This conversion allows us to derive an efficient estimator which reaches the optimal semiparametric efficiency bound. The resulting efficient estimator can exhaustively estimate the central subspace…

基于距离相关学习的特征筛选AI 解读

This paper is concerned with screening features in ultrahigh dimensional data analysis, which has become increasingly important in diverse scientific fields. We develop a sure independence screening procedure based on the distance correlation (DC-SIS, for short). The DC-SIS can be implemented as easily as the sure independence screening procedure based on the Pearson correlation (SIS, for short) proposed by Fan and Lv (2008). However, the DC-SIS can significantly improve the…

降维问题的半参数方法AI 解读

We provide a novel and completely different approach to dimension-reduction problems from the existing literature. We cast the dimension-reduction problem in a semiparametric estimation framework and derive estimating equations. Viewing this problem from the new angle allows us to derive a rich class of estimators, and obtain the classical dimension reduction techniques as special cases in this class. The semiparametric approach also reveals that in the inverse regression…

借助降维估计对主要关注参数进行推断AI 解读

Summary As high dimensional data become routinely available in applied sciences, sufficient dimension reduction has been widely employed and its research has received considerable attention. However, with the majority of sufficient dimension reduction methodology focusing on the dimension reduction step, complete analysis and inference after dimension reduction have yet to receive much attention. We couple the strategy of sufficient dimension reduction with a flexible…