论文检索

三维面板数据中的模型选择后推断AI 解读

Three-dimensional panel models are widely used in empirical analysis. Researchers use various combinations of fixed effects for three-dimensional panels while the correct specification is unknown. When one imposes a parsimonious model and the true model is rich in complexity, the fitted model inevitably incurs the consequences of misspecification including potential bias. When a richly specified model is employed and the true model is parsimonious, then the consequences…

深度分布时间序列模型与日内电价概率预测AI 解读

Summary Recurrent neural networks (RNNs) with rich feature vectors of past values can provide accurate point forecasts for series that exhibit complex serial dependence. We propose two approaches to constructing deep time series probabilistic models based on a variant of RNN called an echo state network (ESN). The first is where the output layer of the ESN has stochastic disturbances and a Bayesian prior for regularization. The second employs the implicit copula of an ESN…

基于梯度的稀疏主成分分析及其在线学习扩展AI 解读

Summary Sparse principal component analysis is an important technique for simultaneous dimensionality reduction and variable selection with high-dimensional data. In this work we combine the unique geometric structure of the sparse principal component analysis problem with recent advances in convex optimization to develop novel gradient-based sparse principal component analysis algorithms. These algorithms enjoy the same global convergence guarantee as the original…

协变量自适应随机化下的 Lasso 调整处理效应估计AI 解读

Summary We consider the problem of estimating and inferring treatment effects in randomized experiments. In practice, stratified randomization, or more generally, covariate-adaptive randomization, is routinely used in the design stage to balance treatment allocations with respect to a few variables that are most relevant to the outcomes. Then, regression is performed in the analysis stage to adjust the remaining imbalances to yield more efficient treatment effect estimators.…

通过稀疏精度矩阵估计高维向量自回归AI 解读

Summary We consider the problem of estimating sparse vector autoregression (VAR) via penalized precision matrices. This matrix is the output of the underlying directed acyclic graph of the VAR process, whose zero components correspond to the zero coefficients of the graphical representation of the VAR. The sparsity-based precision matrix estimator is deduced from the D-trace loss with convex and nonconvex penalty functions. We establish the consistency of the penalized…

含高维协变量的断点回归设计推断AI 解读

Summary We study regression discontinuity designs in which many predetermined covariates, possibly much more than the number of observations, can be used to increase the precision of treatment effect estimates. We consider a two-step estimator which first selects a small number of ‘important’ covariates through a localised lasso-type procedure, and then, in a second step, estimates the treatment effect by including the selected covariates linearly into the usual local linear…

异方差与相关误差线性模型的去偏及阈值化岭回归AI 解读

Abstract High-dimensional linear models with independent errors have been well-studied. However, statistical inference on a high-dimensional linear model with heteroskedastic, dependent (and possibly nonstationary) errors is still a novel topic. Under such complex assumptions, the paper at hand introduces a debiased and thresholded ridge regression estimator that is consistent, and is able to recover the model sparsity. Moreover, we derive a Gaussian approximation theorem…

稀疏高维结构向量自回归的结构推断AI 解读

We consider statistical inference for impulse responses and forecast error variance decompositions in sparse, structural high-dimensional vector autoregressive (SVAR) systems. We introduce consistent estimators of impulse responses in the high-dimensional setting and suggest valid inference procedures for the same parameters. Statistical inference in our setting is much more involved since standard procedures, like the delta-method, do not apply. By using local projection…

摘要暂缺

检测组间函数关系异质性的核部分置换检验AI 解读

We propose a kernel-based partial permutation test for checking the equality of functional relationship between response and covariates among different groups. The main idea, which is intuitive and easy to implement, is to keep the projections of the response vector Y on leading principle components of a kernel matrix fixed and permute Y’s projections on the remaining principle components. The proposed test allows for different choices of kernels, corresponding to different…

高维多变量类别响应回归的似然方法AI 解读

We propose a penalized likelihood method to fit the bivariate categorical response regression model. Our method allows practitioners to estimate which predictors are irrelevant, which predictors only affect the marginal distributions of the bivariate response, and which predictors affect both the marginal distributions and log odds ratios. To compute our estimator, we propose an efficient first order algorithm which we extend to settings where some subjects have only one…

超高维混合类型相关变量的广义因子模型AI 解读

As high-dimensional data measured with mixed-type variables gradually become prevalent, it is particularly appealing to represent those mixed-type high-dimensional data using a much smaller set of so-called factors. Due to the limitation of the existing methods for factor analysis that deal with only continuous variables, in this article, we develop a generalized factor model, a corresponding algorithm and theory for ultra-high dimensional mixed types of variables where both…

最优模拟器选择AI 解读

Computer simulators are widely used for the study of complex systems. In many applications, there are multiple simulators available with different scientific interpretations of the underlying mechanism, and the goal is to identify an optimal simulator based on the observed physical experiments. To achieve the goal, we propose a selection criterion based on leave-one-out cross-validation. This criterion consists of a goodness-of-fit measure and a generalized degrees of…

多元二元数据潜变量模型的GEE辅助变量选择AI 解读

Multivariate data are commonly analyzed using one of two approaches: a conditional approach based on generalized linear latent variable models (GLLVMs) or some variation thereof, and a marginal approach based on generalized estimating equations (GEEs). With research on mixed models and GEEs having gone down separate paths, there is a common mindset to treat the two approaches as mutually exclusive, with which to use driven by the question of interest. In this article,…

自适应采集高维数据的在线去偏及时间序列应用AI 解读

Adaptive collection of data is commonplace in applications throughout science and engineering. From the point of view of statistical inference, however, adaptive data collection induces memory and correlation in the samples, and poses significant challenge. We consider the high-dimensional linear regression, where the samples are collected adaptively, and the sample size n can be smaller than p, the number of covariates. In this setting, there are two distinct sources of…

全局 Fréchet 回归的变量选择AI 解读

Global Fréchet regression is an extension of linear regression to cover more general types of responses, such as distributions, networks, and manifolds, which are becoming more prevalent. In such models, predictors are Euclidean while responses are metric space valued. Predictor selection is of major relevance for regression modeling in the presence of multiple predictors but has not yet been addressed for Fréchet regression. Due to the metric space-valued nature of the…

计算机模型函数校准的再生核希尔伯特空间方法AI 解读

This article develops a frequentist solution to the functional calibration problem, where the value of a calibration parameter in a computer model is allowed to vary with the value of control variables in the physical system. The need of functional calibration is motivated by engineering applications where using a constant calibration parameter results in a significant mismatch between outputs from the computer model and the physical experiment. Reproducing kernel Hilbert…

协作式多标签分类AI 解读

In multilabel classification, strong label dependence is present for exploiting, particularly for word-to-word dependence defined by semantic labels. In such a situation, we develop a collaborative-learning framework to predict class labels based on label-predictor pairs and label-only data. For example, in image categorization and recognition, language expressions describe the content of an image together with a large number of words and phrases without associated images.…

高维删失分位数回归的统计推断AI 解读

With the availability of high dimensional genetic biomarkers, it is of interest to identify heterogeneous effects of these predictors on patients' survival, along with proper statistical inference. Censored quantile regression has emerged as a powerful tool for detecting heterogeneous effects of covariates on survival outcomes. To our knowledge, there is little work available to draw inference on the effects of high dimensional predictors for censored quantile regression.…

通过 Classifier-Lasso 检测有效价格中的未观测异质性AI 解读

This article proposes a new measure of efficient price as a weighted average of bid and ask prices, where the weights are constructed from the bid-ask long-run relationships in a panel error-correction model (ECM). To allow for heterogeneity in the long-run relationships, we consider a panel ECM with latent group structures so that all the stocks within a group share the same long-run relationship and do not otherwise. We extend the Classifier-Lasso method to the ECM to…

高维删失回归模型的 ℓ1 惩罚成对差分估计AI 解读

High-dimensional data are nowadays readily available and increasingly common in various fields of empirical economics. This article considers estimation and model selection for a high-dimensional censored linear regression model. We combine l1-penalization method with the ideas of pairwise difference and propose an l1-penalized pairwise difference least absolute deviations (LAD) estimator. Estimation consistency and model selection consistency of the estimator are…

高维向量自回归模型的速率最优稳健估计AI 解读

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series, but also the existence of aberrant observations, such as missing values, contaminated observations, and heavy-tailed distributions. For high-dimensional vector autoregressive (VAR) models, we introduce a unified estimation procedure that is…

最优应对 RKHS 非参数回归中的协变量偏移AI 解读

We study the covariate shift problem in the context of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We focus on two natural families of covariate shift problems defined using the likelihood ratios between the source and target distributions. When the likelihood ratios are uniformly bounded, we prove that the kernel ridge regression (KRR) estimator with a carefully chosen regularization parameter is minimax rate-optimal (up to a log factor) for a…

凸正则化估计量的去偏与线性模型区间估计AI 解读

New upper bounds are developed for the L2 distance between ξ/Var[ξ]1/2 and linear and quadratic functions of z∼N(0,In) for random variables of the form ξ=z⊤f(z)−divf(z). The linear approximation yields a central limit theorem when the squared norm of f(z) dominates the squared Frobenius norm of ∇f(z) in expectation. Applications of this normal approximation are given for the asymptotic normality of debiased estimators in linear regression with correlated design and convex…