论文检索

Fréchet累积协方差网络：随机对象的深度非线性充分降维AI 解读

Nonlinear sufficient dimension reduction\citep{libing_generalSDR}, which constructs nonlinear low-dimensional representations to summarize essential features of high-dimensional data, is an important branch of representation learning. However, most existing methods are not applicable when the response variables are complex non-Euclidean random objects, which are frequently encountered in many recent statistical applications. In this paper, we introduce a new statistical…

预印本版本摘要 · 查看来源

积分概率度量引导的 CUSUM-Net 非参数变点检测AI 解读

Abstract We propose CUSUM-Net, a nonparametric method for changepoint detection based on integral probability metrics and deep neural networks. Our approach learns a critic function by maximizing an aggregate CUSUM objective over candidate changepoints, thereby linking changepoint detection to optimization of two-sample integral probability metrics. The learned critic induces a one-dimensional representation on which changepoints are localized by a classical CUSUM scan.…

内蕴黎曼函数型充分降维及其扩展AI 解读

This article focuses on linear sufficient dimension reduction with Riemannian random processes as predictors and complex random objects in a metric space as responses. We propose two novel methods—Intrinsic Riemannian Functional Weighted Inverse Regression Ensemble (iRF-WIRE) and Intrinsic Riemannian Functional Weighted Directional Regression (iRF-WDR)—to recover the central subspace. These methods can be readily extended to Wasserstein functional predictors. We establish…

神经网络与随机森林的融合AI 解读

Abstract Neural networks and random forests are popular and promising tools for machine learning. This article explores the proper integration of these two approaches for nonparametric regression to improve the performance of a single approach. Specifically, we propose a neural network estimator with local enhancement provided by random forests. It naturally synthesizes the local relation adaptivity of random forests and the strong global approximation ability of neural…

深度非线性充分降维AI 解读

Linear sufficient dimension reduction, as exemplified by sliced inverse regression, has seen substantial development in the past thirty years. However, with the advent of more complex scenarios, nonlinear dimension reduction has gained considerable interest recently. This paper introduces a novel method for nonlinear sufficient dimension reduction, utilizing the generalized martingale difference divergence measure in conjunction with deep neural networks. The optimal…

随机对象的 Fréchet 充分降维AI 解读

Summary We consider Fréchet sufficient dimension reduction with responses being complex random objects in a metric space and high-dimensional Euclidean predictors. We propose a novel approach, called the weighted inverse regression ensemble method, for linear Fréchet sufficient dimension reduction. The method is further generalized as a new operator defined on reproducing kernel Hilbert spaces for nonlinear Fréchet sufficient dimension reduction. We provide theoretical…

降维后的统计推断AI 解读

The methodologies of sufficient dimension reduction have undergone extensive developments in the past three decades. However, there has been a lack of systematic and rigorous development of post dimension reduction inference, which has seriously hindered its applications. The current common practice is to treat the estimated sufficient predictors as the true predictors and use them as the starting point of the downstream statistical inference. However, this naive inference…

稀疏切片逆回归：最优收敛率与自适应估计AI 解读

Sliced inverse regression (SIR) is an innovative and effective method for sufficient dimension reduction and data visualization. Recently, an impressive range of penalized SIR methods has been proposed to estimate the central subspace in a sparse fashion. Nonetheless, few of them considered the sparse sufficient dimension reduction from a decision-theoretic point of view. To address this issue, we in this paper establish the minimax rates of convergence for estimating the…

用于超高维无模型特征选择的边际切片逆回归AI 解读

Model-free variable selection has been implemented under the sufficient dimension reduction framework since the seminal paper of Cook [Ann. Statist. 32 (2004) 1062–1092]. In this paper, we extend the marginal coordinate test for sliced inverse regression (SIR) in Cook (2004) and propose a novel marginal SIR utility for the purpose of ultrahigh dimensional feature selection. Two distinct procedures, Dantzig selector and sparse precision matrix estimation, are incorporated to…

迹追踪：无模型变量选择的一般框架AI 解读

We propose trace pursuit for model-free variable selection under the sufficient dimension-reduction paradigm. Two distinct algorithms are proposed: stepwise trace pursuit and forward trace pursuit. Stepwise trace pursuit achieves selection consistency with fixed p. Forward trace pursuit can serve as an initial screening step to speed up the computation in the case of ultrahigh dimensionality. The screening consistency property of forward trace pursuit based on sliced inverse…

部分充分降维及其在部分线性多指标模型中的应用AI 解读

Partial dimension reduction is a general method to seek informative convex combinations of predictors of primary interest, which includes dimension reduction as its special case when the predictors in the remaining part are constants. In this article, we propose a novel method to conduct partial dimension reduction estimation for predictors of primary interest without assuming that the remaining predictors are categorical. To this end, we first take the dichotomization step…