论文检索

利用贝叶斯上下文树检测离散数据变点并进行分段AI 解读

A new Bayesian modelling framework is introduced for piece-wise homogeneous variable-memory Markov chains, along with a collection of effective algorithmic tools for change-point detection and segmentation of discrete time series. Building on the recently introduced Bayesian Context Trees (BCT) framework, the distributions of different segments in a discrete time series are described as variable-memory Markov chains. Inference for the presence and location of change-points…

函数型时间序列中的渐进变化AI 解读

We consider the problem of detecting gradual changes in the sequence of mean functions from a not necessarily stationary functional time series. Our approach is based on the maximum deviation (calculated over a given time interval) between a benchmark function and the mean functions at different time points. We speak of a gradual change of size $Δ$, if this quantity exceeds a given threshold $Δ>0$. For example, the benchmark function could represent an average of yearly…

处理效应能否摆脱多重共线性？因果推断中的时间顺序与 Gram–Schmidt 正交化AI 解读

This paper incorporates information about the temporal order of regressors to estimate orthogonal and economically interpretable regression coefficients. We establish new finite sample properties for the Gram-Schmidt orthogonalization process. Coefficients are unbiased and stable with lower standard errors than those from Ordinary Least Squares. We provide conditions under which coefficients represent average total treatment effects on the treated and extend the model to…

稳定蒸馏与高维假设检验AI 解读

While powerful methods have been developed for high-dimensional hypothesis testing assuming orthogonal parameters, current approaches struggle to generalize to the more common non-orthogonal case. We propose Stable Distillation (SD), a simple paradigm for iteratively extracting independent pieces of information from observed data, assuming a parametric model. When applied to hypothesis testing for large regression models, SD orthogonalizes the effect estimates of…

熵调整图Lasso的稀疏精度矩阵估计AI 解读

The estimation of a precision matrix is a crucial problem in various research fields, particularly when working with high dimensional data. In such settings, the most common approach is to use the penalized maximum likelihood. The literature typically employs Lasso, Ridge and Elastic Net norms, which effectively shrink the entries of the estimated precision matrix. Although these shrinkage approaches provide well-conditioned precision matrix estimates, they do not explicitly…

RUM-NN：兼容随机效用最大化的离散选择神经网络AI 解读

This paper introduces a framework for capturing stochasticity of choice probabilities in neural networks, derived from and fully consistent with the Random Utility Maximization (RUM) theory, referred to as RUM-NN. Neural network models show remarkable performance compared with statistical models; however, they are often criticized for their lack of transparency and interoperability. The proposed RUM-NN is introduced in both linear and nonlinear structures. The linear RUM-NN…

用于调节效应分析的因果机器学习AI 解读

It is valuable for any decision maker to know the impact of decisions (treatments) on average and for subgroups. The causal machine learning literature has recently provided tools for estimating group average treatment effects (GATE) to better describe treatment heterogeneity. This paper addresses the challenge of interpreting such differences in treatment effects between groups while accounting for variations in other covariates. We propose a new parameter, the balanced…

美国各州月度 GDP 增长估计AI 解读

This paper develops a mixed frequency vector autoregressive (MF-VAR) model to produce nowcasts and historical estimates of monthly real state-level GDP for the 50 U.S. states, plus Washington DC, from 1964 through the present day. The MF-VAR model incorporates state and U.S. data at the monthly, quarterly, and annual frequencies. Temporal and cross-sectional constraints are imposed to ensure that the monthly state-level estimates are consistent with official estimates of…

带变量选择的多阶段平稳处理策略的渐近推断AI 解读

Dynamic treatment regimes or policies are a sequence of decision functions over multiple stages that are tailored to individual features. One important class of treatment policies in practice, namely multi-stage stationary treatment policies, prescribes treatment assignment probabilities using the same decision function across stages, where the decision is based on the same set of features consisting of time-evolving variables (e.g., routinely collected disease biomarkers).…

模型能用多久？选择大型预测模型重拟合时机的决策理论方法AI 解读

Large-scale prediction models using tools from artificial intelligence (AI) or machine learning (ML) are increasingly common across a variety of industries and scientific domains. Despite their effectiveness, training AI and ML tools at scale can cost tens or hundreds of thousands of dollars (or more); and even after a model is trained, substantial resources must be invested to keep models up-to-date. This paper presents a decision-theoretic framework for deciding when to…

因果与非因果混合过程的序贯蒙特卡洛估计AI 解读

This paper proposes a Sequential Monte Carlo approach for the Bayesian estimation of mixed causal and noncausal models. Unlike previous Bayesian estimation methods developed for these models, Sequential Monte Carlo offers extensive parallelization opportunities, significantly reducing estimation time and mitigating the risk of becoming trapped in local minima, a common issue in noncausal processes. Simulation studies demonstrate the strong ability of the algorithm to produce…

半参数回归中双重机器学习的双重稳健推断AI 解读

Due to concerns about parametric model misspecification, there is interest in using machine learning to adjust for confounding when evaluating the causal effect of an exposure on an outcome. Unfortunately, exposure effect estimators that rely on machine learning predictions are generally subject to so-called plug-in bias, which can render naive $p$-values and confidence intervals invalid. Progress has been made via proposals like targeted minimum loss estimation and more…

辅助学习及其统计理解AI 解读

Modern statistical analysis often encounters high-dimensional problems but with a limited sample size. It poses great challenges to traditional statistical estimation methods. In this work, we adopt auxiliary learning to solve the estimation problem in high-dimensional settings. We start with the linear regression setup. To improve the statistical efficiency of the parameter estimator for the primary task, we consider several auxiliary tasks, which share the same covariates…

间歇性时间序列的复杂性损失建模及其应用AI 解读

In this paper, we developed a novel method of nonparametric relative entropy (RlEn) for modelling loss of complexity in intermittent time series. The method consists of two steps. We first fit a nonlinear autoregressive model to each intermittent time series, where the corresponding lag order and the loss of complexity are determined by Bayesian Information Criterion (BIC) and relative entropy respectively. Then, change-points in the complexity are detected by a cumulative…

带协变量的伯努利试验中处理分配的最优相关结构AI 解读

Given covariates for $n$ units, each of which is to receive a treatment with probability $1/2$, we study the question of how best to correlate their treatment assignments to minimize the variance of the IPW estimator of the average treatment effect. Past work by \cite{bai2022} found that the optimal stratified experiment is a matched-pair design, where the matching depends on oracle knowledge of the distributions of potential outcomes given covariates. We study the strictly…

基于最大似然估计的无监督凸正则化器训练AI 解读

Imaging is a standard example of an inverse problem, where the task of reconstructing a ground truth from a noisy measurement is ill-posed. Recent state-of-the-art approaches for imaging use deep learning, spearheaded by unrolled and end-to-end models and trained on various image datasets. However, many such methods require the availability of ground truth data, which may be unavailable or expensive, leading to a fundamental barrier that can not be bypassed by choice of…

基于高斯过程先验的非线性结构化潜因子模型贝叶斯分析AI 解读

Factor analysis models are widely utilized in social and behavioral sciences, such as psychology, education, and marketing, to measure unobservable latent traits. In this article, we introduce a nonlinear structured latent factor analysis model which is more flexible to characterize the relationship between manifest variables and latent factors. The confirmatory identifiability of the latent factor is discussed, ensuring the substantive interpretation of the latent factors.…

具有经验学习机制的非平稳非线性群组面板最小二乘估计AI 解读

We discuss techniques of estimation and inference for nonstationary nonlinear cohort panels with learning from experience, showing, inter alia, the consistency and asymptotic normality of the nonlinear least squares estimator used in empirical practice. Potential pitfalls for hypothesis testing are identified and solutions proposed. Monte Carlo simulations verify the properties of the estimator and corresponding test statistics in finite samples, while an application to a…

增强 Lee 界的稳健性并收紧区间：随机单调性与对称性下的样本选择模型AI 解读

In the presence of sample selection, Lee's (2009) nonparametric bounds are a popular tool for estimating a treatment effect. However, the Lee bounds rely on the monotonicity assumption, whose empirical validity is sometimes unclear. Furthermore, the bounds are often regarded to be wide and less informative even under monotonicity. To address these issues, this study introduces a stochastic version of the monotonicity assumption alongside a nonparametric distributional shape…

重新审视硬阈值追踪：全自适应与锐利估计AI 解读

Hard Thresholding Pursuit (HTP) has aroused increasing attention for its robust theoretical guarantees and impressive numerical performance in non-convex optimization. In this paper, we introduce a novel tuning-free procedure, named Full-Adaptive HTP (FAHTP), that simultaneously adapts to both the unknown sparsity and signal strength of the underlying model. We provide an in-depth analysis of the iterative thresholding dynamics of FAHTP, offering refined theoretical…

含潜在因子的单指数模型高维推断AI 解读

Models with latent factors recently attract a lot of attention. However, most investigations focus on linear regression models and thus cannot capture nonlinearity. To address this issue, we propose a novel Factor Augmented Single-Index Model. We first address the concern whether it is necessary to consider the augmented part by introducing a score-type test statistic. Compared with previous test statistics, our proposed test statistic does not need to estimate the…

结构化函数因子增广下的稀疏学习AI 解读

As one of the most powerful tools for examining the association between functional covariates and a response, the functional regression model has been widely adopted in various interdisciplinary studies. Usually, a limited number of functional covariates are assumed in a functional linear regression model. Nevertheless, correlations may exist between functional covariates in high-dimensional functional linear regression models, which brings significant statistical challenges…

含共同随机趋势与多因子误差结构的矩阵时间序列推断AI 解读

We develop an estimation methodology for a factor model for high-dimensional matrix-valued time series, where common stochastic trends and common stationary factors can be present. We study, in particular, the estimation of (row and column) loading spaces, of the common stochastic trends and of the common stationary factors, and the row and column ranks thereof. In a set of (negative) preliminary results, we show that a projection-based technique fails to improve the rates…

多变量连续处理的效应异质性与重要性度量AI 解读

Estimating the joint effect of a multivariate, continuous exposure is crucial, particularly in environmental health where interest lies in simultaneously evaluating the impact of multiple environmental pollutants on health. We develop novel methodology that addresses two key issues for estimation of treatment effects of multivariate, continuous exposures. We use nonparametric Bayesian methodology that is flexible to ensure our approach can capture a wide range of data…