Miguel C. Herculano · Santiago Montoya-Blandón·首次提交 2024-12-09 · 修订 2026-01-09 · v5·arXiv预印本
概率靶向因子分析AI 解读
We develop Probabilistic Targeted Factor Analysis (PTFA), a likelihood-based framework for constructing latent factors that are explicitly targeted to variables of economic interest. PTFA provides a probabilistic foundation for Partial Least Squares, allowing supervised factor extraction under uncertainty. The model is estimated via a fast expectation maximization algorithm and naturally accommodates missing data, mixed-frequency observations, stochastic volatility, and…
Muhammad Usman Anwar Goraya·首次提交 2026-01-09 · 修订 2026-01-09 · v1·arXiv预印本
援助与冲突的复杂关系:面板计量与综合指数的证据AI 解读
This paper examines the relationship between Official Development Assistance (ODA) and conflict in the ten largest aid-receiving African countries between 2009 and 2023. Using Ordinary Least Squares, Principal Component Analysis, and Ridge (L2) regression, the study assesses whether conflict, proxied by political stability, governance indicators, and macroeconomic conditions, systematically influences aid inflows. Results reveal a nuanced relationship. Pooled regressions…
Jing Ouyang · Chengyu Cui · Kean Ming Tan · Gongjun Xu·首次提交 2024-04-25 · 修订 2026-01-09 · v3·arXiv预印本
协变量调整的可解释广义因子模型推断及测验公平性应用AI 解读
Latent variable models are popularly used to measure latent factors (e.g., abilities and personalities) from large-scale assessment data. Beyond understanding these latent factors, the covariate effect on responses controlling for latent factors is also of great scientific interest and has wide applications, such as evaluating the fairness of educational testing, where the covariate effect reflects whether a test question is biased toward certain individual characteristics…
This paper establishes a rigorous theoretical foundation for the function class implicitly learned by XGBoost, bridging the gap between its empirical success and our theoretical understanding. We introduce an infinite-dimensional function class $\mathcal{F}^{d, s}_{\infty-\text{ST}}$ that extends finite ensembles of bounded-depth regression trees, together with a complexity measure $V^{d, s}_{\infty-\text{XGB}}(\cdot)$ that generalizes the $L^1$ regularization penalty used…
Yiqun T Chen · Sizhu Lu · Sijia Li · Moran Guo · Shengyi Li·首次提交 2026-01-08 · 修订 2026-01-08 · v1·arXiv预印本
Large language models (LLMs) are increasingly used as automatic evaluators of generative AI outputs, a paradigm often referred to as "LLM-as-a-judge." In practice, LLM judges are imperfect predictions for the underlying truth and can exhibit systematic, non-random errors. Two main approaches have recently been proposed to address this issue: (i) direct measurementerror correction based on misclassification models such as Rogan-Gladen-style estimators, and (ii)…
James Rice·首次提交 2026-01-08 · 修订 2026-01-08 · v1·arXiv预印本
随机深度学习:结构化时间数据不确定性建模的概率框架AI 解读
I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach, termed Stochastic Latent Differential Inference (SLDI), embeds an Itô SDE in the latent space of a variational autoencoder, allowing for flexible, continuous-time modeling of uncertainty while preserving a principled mathematical…
This paper proposes a new methodological framework for estimating inferential models with latent variables. It also introduces a new latent variable regression model called LARX: an extension of the ubiquitous autoregressive model with exogenous inputs (ARX) in which any or all input variables can be latent. In deriving the LARX model, a minor contribution is also made to the field of matrix calculus: A new matrix operator is defined and applied to solve a class of…
Statistical inference in contextual bandits is challenging due to the adaptive, non-i.i.d. nature of the data. A growing body of work shows that classical least-squares inference can fail under adaptive sampling, and that valid confidence intervals for linear functionals typically require an inflation of order $\sqrt{d \log T}$. This phenomenon -- often termed the price of adaptivity -- reflects the intrinsic difficulty of reliable inference under general contextual bandit…
Kumar Utkarsh · Nirmish R. Shah · Tanvi Banerjee · Daniel M. Abrams·首次提交 2026-01-08 · 修订 2026-01-08 · v1·arXiv预印本
短时间序列增广新方法及其在镰状细胞病疼痛事件中的应用AI 解读
Researchers across different fields, including but not limited to ecology, biology, and healthcare, often face the challenge of sparse data. Such sparsity can lead to uncertainties, estimation difficulties, and potential biases in modeling. Here we introduce a novel data augmentation method that combines multiple sparse time series datasets when they share similar statistical properties, thereby improving parameter estimation and model selection reliability. We demonstrate…
Changjun Li · Heather Allore · Michael O. Harhay · Fan Li · Guangyu Tong·首次提交 2025-11-18 · 修订 2026-01-07 · v2·arXiv预印本
揭示实用性老年医学试验中的处理效应异质性AI 解读
Detecting heterogeneity in treatment response enriches the interpretation of gerontologic trials. In aging research, estimating the effect of the intervention on clinically meaningful outcomes faces analytical challenges when it is truncated by death. For example, in the Whole Systems Demonstrator trial, a large cluster-randomized study evaluating telecare among older adults, the overall effect of the intervention on quality of life was found to be null. However, this…
Zhenyu Wang · Yifan Hu · Peter Bühlmann · Zijian Guo·首次提交 2024-12-16 · 修订 2026-01-07 · v3·arXiv预印本
通过高效非凸优化学习因果不变性AI 解读
Identifying the causal relationship among variables from observational data is an important yet challenging task. This work focuses on identifying the direct causes of an outcome and estimating their magnitude, i.e., learning the causal outcome model. Data from multiple environments provide valuable opportunities to uncover causality by exploiting the invariance principle that the causal outcome model holds across heterogeneous environments. Based on the invariance…
We study a ridge estimator for the high-dimensional two-way fixed effect regression model with a sparse bipartite network. We develop concentration inequalities showing that when the ridge parameters increase as the log of the network size, the bias, and the variance-covariance matrix of the vector of estimated fixed effects converge to deterministic equivalents that depend only on the expected network. We provide simulations and an application using administrative data on…
Factor extraction from systems of variables with a large cross-sectional dimension, $N$, is often based on either Principal Components (PC)-based procedures, or Kalman filter (KF)-based procedures. Measuring the uncertainty of the extracted factors is important when, for example, they have a direct interpretation and/or they are used to summarized the information in a large number of potential predictors. In this paper, we compare the finite $N$ mean square errors (MSEs) of…
Tomeu López-Nieto-Veitch · Rossella De Sabbata · Ryung Kim · Sven Ove Samuelsen · Nathalie C. Støer 等 6 位作者·首次提交 2026-01-07 · 修订 2026-01-07 · v1·arXiv预印本
嵌套病例对照研究加权分析中的纳入概率估计AI 解读
Nested case-control (NCC) studies are a widely adopted design in epidemiology to investigate exposure-disease relationships. This paper examines weighted analyses in NCC studies, focusing on two prominent weighting methods: Kaplan-Meier (KM) weights and Generalized Additive Model (GAM) weights. We consider three target estimands: log-hazard ratios, conditional survival, and associations between exposures. While KM- and GAM-weights are generally robust, we identify specific…
Panel local projection (LP) with fixed-effects (FE) is widely adopted for evaluating the economic consequences of financial crises across countries. This paper highlights a fundamental methodological issue: the presence of the Nickell bias in the panel FE estimator due to inherent dynamic structures of predictive specifications, even if the regressors have no lagged dependent variables. The Nickell bias invalidates the standard inferential procedure based on the $t$-statistic…
Local polynomial density (LPD) estimators are widely used for inference on boundary features of the density function. Contrary to conventional wisdom, we show that kernel choice substantially affects efficiency. Theory, simulations, and empirical evidence indicate that the popular triangular kernel delivers large mean squared error, wide confidence intervals, and limited power for detecting discontinuities. Moreover, small-sample variance can explode because the…
Shizhe Hong · Weiming Li · Guangming Pan·首次提交 2026-01-07 · 修订 2026-01-07 · v1·arXiv预印本
We propose a novel estimation framework for quadratic functionals of precision matrices in high-dimensional settings, particularly in regimes where the feature dimension $p$ exceeds the sample size $n$. Traditional moment-based estimators with bias correction remain consistent when $p n$, highlighting a fundamental distinction between the two regimes due to rank deficiency and high-dimensional complexity. Our approach resolves these issues by combining a spectral-moment…
Gabriel Saco·首次提交 2025-12-08 · 修订 2026-01-07 · v2·arXiv预印本
双重机器学习中病态正交得分的误差放大AI 解读
Double Machine Learning is often justified by nuisance-rate conditions, yet finite-sample reliability also depends on the conditioning of the orthogonal-score Jacobian. This conditioning is typically assumed rather than tracked. When residualized treatment variance is small, the Jacobian is ill-conditioned and small systematic nuisance errors can be amplified, so nominal confidence intervals may look precise yet systematically under-cover. Our main result is an exact…
This paper considers an approximate dynamic matrix factor model that accounts for the time series nature of the data by explicitly modelling the time evolution of the factors. We study estimation of the model parameters based on the Expectation Maximization (EM) algorithm, implemented jointly with the Kalman smoother which gives estimates of the factors. We establish the consistency of the estimated loadings and factor matrices as the sample size $T$ and the matrix…
This paper derives limit properties of nonparametric kernel regression estimators without requiring existence of density for regressors in $\mathbb{R}^{q}.$ In functional regression limit properties are established for multivariate functional regression. The rate and asymptotic normality for the Nadaraya-Watson (NW) estimator is established for distributions of regressors in $\mathbb{R}^{q}$ that allow for mass points, factor structure, multicollinearity and nonlinear…
Apu Chandra Das · Sakib Salam · Aninda Roy · Rakhi Chowdhury · Antar Chandra Das 等 6 位作者·首次提交 2026-01-07 · 修订 2026-01-07 · v1·arXiv预印本
利用倾向得分加权与分部借用幂先验增强临床试验对照组AI 解读
Borrowing external data can improve estimation efficiency but may introduce bias when populations differ in covariate distributions or outcome variability. A proper balance needs to be maintained between the two datasets to justify the borrowing. We propose a propensity score weighting borrowing-by-parts power prior (PSW-BPP) that integrates causal covariate adjustment through propensity score weighting with a flexible Bayesian borrowing approach to address these challenges…
Consider a setup in which a decision maker is informed about the population by a finite sample and based on that sample has to decide whether or not to apply a certain treatment. We work out finite sample minimax regret treatment rules under various sampling schemes when outcomes are restricted onto the unit interval. In contrast to Stoye (2009) where the focus is on maximization of expected utility the focus here is instead on a particular quantile of the outcome…
Philipp Sterzinger · Ioannis Kosmidis·首次提交 2023-11-13 · 修订 2026-01-06 · v3·arXiv预印本
We characterise the behavior of the maximum Diaconis--Ylvisaker prior penalized likelihood estimator in high-dimensional logistic regression, where the number of covariates is a fraction $κ\in (0,1)$ of the number of observations $n$, as $n \to \infty$. We construct a rescaled estimator with zero asymptotic aggregate bias and define adjusted $Z$-statistics and rescaled penalized likelihood ratio statistics that exhibit the typical null asymptotic distributions, when the…
Edoardo Efrem Gervasoni · Liesbet De Bus · Stijn Vansteelandt · Oliver Dukes·首次提交 2026-01-06 · 修订 2026-01-06 · v1·arXiv预印本
目标试验模拟中的目标估计量AI 解读
The target trial framework enables causal inference from longitudinal observational data by emulating randomized trials initiated at multiple time points. Precision is often improved by pooling information across trials, with standard models typically assuming - among other things - a time-constant treatment effect. However, this obscures interpretation when the true treatment effect varies, which we argue to be likely as a result of relying on noncollapsible estimands. To…
This paper establishes a rigorous theoretical foundation for the function class implicitly learned by XGBoost, bridging the gap between its empirical success and our theoretical understanding. We introduce an infinite-dimensional function class F∞−STd,s that extends finite ensembles of bounded-depth regression trees, together with a complexity measure V∞−XGBd,s(⋅) that generalizes the L1 regularization penalty used…
Statistical inference in contextual bandits is challenging due to the adaptive, non-i.i.d. nature of the data. A growing body of work shows that classical least-squares inference can fail under adaptive sampling, and that valid confidence intervals for linear functionals typically require an inflation of order dlogT. This phenomenon -- often termed the price of adaptivity -- reflects the intrinsic difficulty of reliable inference under general contextual bandit…
Factor extraction from systems of variables with a large cross-sectional dimension, N, is often based on either Principal Components (PC)-based procedures, or Kalman filter (KF)-based procedures. Measuring the uncertainty of the extracted factors is important when, for example, they have a direct interpretation and/or they are used to summarized the information in a large number of potential predictors. In this paper, we compare the finite N mean square errors (MSEs) of…
Panel local projection (LP) with fixed-effects (FE) is widely adopted for evaluating the economic consequences of financial crises across countries. This paper highlights a fundamental methodological issue: the presence of the Nickell bias in the panel FE estimator due to inherent dynamic structures of predictive specifications, even if the regressors have no lagged dependent variables. The Nickell bias invalidates the standard inferential procedure based on the t-statistic…
High-Dimensional Precision Matrix Quadratic Forms: Estimation Framework for p>n
We propose a novel estimation framework for quadratic functionals of precision matrices in high-dimensional settings, particularly in regimes where the feature dimension p exceeds the sample size n. Traditional moment-based estimators with bias correction remain consistent when pn, highlighting a fundamental distinction between the two regimes due to rank deficiency and high-dimensional complexity. Our approach resolves these issues by combining a spectral-moment…
This paper considers an approximate dynamic matrix factor model that accounts for the time series nature of the data by explicitly modelling the time evolution of the factors. We study estimation of the model parameters based on the Expectation Maximization (EM) algorithm, implemented jointly with the Kalman smoother which gives estimates of the factors. We establish the consistency of the estimated loadings and factor matrices as the sample size T and the matrix…
This paper derives limit properties of nonparametric kernel regression estimators without requiring existence of density for regressors in Rq. In functional regression limit properties are established for multivariate functional regression. The rate and asymptotic normality for the Nadaraya-Watson (NW) estimator is established for distributions of regressors in Rq that allow for mass points, factor structure, multicollinearity and nonlinear…
Diaconis-Ylvisaker prior penalized likelihood for p/n→κ∈(0,1) logistic regression
We characterise the behavior of the maximum Diaconis--Ylvisaker prior penalized likelihood estimator in high-dimensional logistic regression, where the number of covariates is a fraction κ∈(0,1) of the number of observations n, as n→∞. We construct a rescaled estimator with zero asymptotic aggregate bias and define adjusted Z-statistics and rescaled penalized likelihood ratio statistics that exhibit the typical null asymptotic distributions, when the…