论文检索

利用渐进分位数增强离群值抵抗力：快速算法与理论研究AI 解读

Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this article, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a close connection to the method of trimming and includes explicit outlyingness parameters for all samples, which in turn facilitates computation, theory, and parameter tuning. To tackle the issues of nonconvexity and nonsmoothness, we…

耦合生成：结合直接与间接生成器的实例生成方法AI 解读

Instance generation creates representative examples to interpret a learning model, as in regression and classification. For example, representative sentences of a topic of interest describe the topic specifically for sentence categorization. In such a situation, a large number of unlabeled observations may be available in addition to labeled data, for example, many unclassified text corpora (unlabeled instances) are available with only a few classified sentences (labeled…

机器学习时间序列回归及其即时预测应用AI 解读

This article introduces structured machine learning regressions for high-dimensional time series data potentially sampled at different frequencies. The sparse-group LASSO estimator can take advantage of such time series data structures and outperforms the unstructured LASSO. We establish oracle inequalities for the sparse-group LASSO estimator within a framework that allows for the mixing processes and recognizes that the financial and the macroeconomic data may have heavier…

多维聚类稳健的双重／去偏机器学习AI 解读

This article investigates double/debiased machine learning (DML) under multiway clustered sampling environments. We propose a novel multiway cross-fitting algorithm and a multiway DML estimator based on this algorithm. We also develop a multiway cluster robust standard error formula. Simulations indicate that the proposed procedure has favorable finite sample performance. Applying the proposed method to market share data for demand analysis, we obtain larger two-way cluster…

唐彦博对《广义线性模型参数的弱假设推断》的讨论AI 解读

The method proposed by Vansteelandt and Dukes is an interesting combination of non-parametric and machine learning techniques with traditional ideas in statistics. We note in this discussion that the authors' argument is easily extended to obtain a quantitative rate in terms of the quality of the nonparametric conditional mean estimate, and comment on how this may impact a practitioner's choice of the machine learning model used to estimate the conditional mean. However the…

Phillips 与 van der Laan 对《广义线性模型参数的弱假设推断》的讨论AI 解读

We commend the authors on this novel non-parametric extension of main and interaction coefficients in a generalised linear model (GLM), such as E(Y|A,L)=βA+g(L)⁠, and their efficient estimation. There is a wealth of non-parametric extensions one could pursue, including weighted squared error projections of a conditional treatment effect E(Y|A=a,L)-E(Y|A=0,L) and conditional interaction effect E(Y|A=(a1+1,a2+1),L)-E(Y|A=(a1,a2+1),L)-E(Y|A=(a1+1,a2),L)+E(Y|A=(a1,a2),L) onto a…

Ogburn 等对《广义线性模型参数的弱假设推断》的讨论AI 解读

Not all conditional associations between outcomes and exposures are of interest. Those that are tend to be directional: up or down. The simplest way to assess directionality is to fit a confounder- adjusted linear exposure term, as the authors propose. We agree with this approach as some of us have argued that linear slopes are meaningful and interpretable even if the directional association is not linear (Buja et al., 2019, section 10). The authors, and Whitney et al.…

Kuldeep Kumar 对《广义线性模型参数的弱假设推断》的讨论AI 解读

According to Leo Breiman (2001), there are two broad cultures for analysing and modelling to reach conclusions from the data. The first one is data modelling culture where the value of the parameters are estimated from the data and then the model is used for information and/or prediction. The second one is algorithmic modelling culture, where the approach is to find a function f(x) using an algorithm that operates on x to predict y. In the first case, statistical tools like…

Ian Hunt 对《广义线性模型参数的少假设推断》的讨论AI 解读

This paper offers a generic and principled addition to conventional statistical modelling. It is a real advance in applicable methodology. But there is no need in the paper for the following claims: that statisticians routinely use ‘dishonest’ modelling assumptions, that statisticians should aim for ‘purely evidence-based’ inferences and that modelling assumptions are ‘almost always a pure mathematical convenience’. These sorts of claims are redundant or misleading for three…

董朝华、高继挺与 Oliver Linton 对《广义线性模型参数的弱假设推断》的讨论AI 解读

The title of this paper is ironically self-fulfilling, since there are almost no meaningful assumptions made throughout! The starting point is that we have some plausible semi-parametric model, which is a special case of a more general non-parametric model, but we wish to allow for misspecification and in particular define an estimand that is meaningful in the non-parametric model and that specialises in the plausible model to a slope coefficient. However, since the…

Choi 与 Wong 对《广义线性模型参数的弱假设推断》的讨论AI 解读

We congratulate the authors for major advances in the methodology of estimands, in particular assumption-lean reference for the estimands in possibly misspecified generalised linear models. Whereas the simulation studies in Section 6 indeed support the ‘assumption-lean’ claim and the authors’ software in Practice of Epidemiology187 (pp. 1079–1084, 2018) facilitates such inference, the empirical example in Section 7 seems problematic to illustrate applications of the…

Blair Bilodeau 对“广义线性模型参数的弱假设推断”的讨论AI 解读

I commend Vansteelandt and Dukes for (a) advocating that statistics move beyond well-specified assumptions and (b) providing a practical estimator to address this for generalised linear models (GLMs). Furthermore, their derivation of theoretical guarantees for this estimator is highly attractive. However, the theorem assumptions exclude many standard machine learning methods, which may violate the spirit of ‘assumption-lean’ inference guarantees. Theorems 2 and 4 assume that…

Pallavi Basu 对《广义线性模型参数的弱假设推断》的讨论AI 解读

The authors propose an ingenious way to improve on providing inference for the main and interaction effects for generalised linear model parameters. With the use of the efficient influence function, they can extend the allowable bias introduced by machine learning estimators up to op(n −1/4). Noting that cross-fitting has been suggested to counter the Donsker condition, it may be a useful alternative to contrast with machine learning estimates, averages over sample splits or…

《广义线性模型参数的弱假设推断》讨论与致谢附议AI 解读

In my view, one of the most important contributions of the field of causal inference has been to place the target of inference, the desired estimand, at the centre of the analysis. The estimand is chosen in view of the research question, and typically reflects what decision problem we need to solve or what our ideal (target) trial would be. Crucially, the (causal) estimand is not automatically a parameter that happens to parametrise a chosen model. The role of models is…

广义线性模型参数的弱假设推断AI 解读

Abstract Inference for the parameters indexing generalised linear models is routinely based on the assumption that the model is correct and a priori specified. This is unsatisfactory because the chosen model is usually the result of a data-adaptive model selection process, which may induce excess uncertainty that is not usually acknowledged. Moreover, the assumptions encoded in the chosen model rarely represent some a priori known, ground truth, making standard inferences…

Boosting 与最小 ℓ1 范数插值分类器的精确高维渐近理论AI 解读

This paper establishes a precise high-dimensional asymptotic theory for boosting on separable data, taking statistical and computational perspectives. We consider a high-dimensional setting where the number of features (weak learners) p scales with the sample size n, in an overparametrized regime. Under a class of statistical models, we provide an exact analysis of the generalization error of boosting when the algorithm interpolates the training data and maximizes the…

Wasserstein 距离下光滑密度的极小极大估计AI 解读

We study nonparametric density estimation problems where error is measured in the Wasserstein distance, a metric on probability distributions popular in many areas of statistics and machine learning. We give the first minimax-optimal rates for this problem for general Wasserstein distances for two classes of densities: smooth probability densities on [0,1]d bounded away from 0, and sub-Gaussian densities lying in the Hölder class Cs, s∈(0,1). Unlike classical nonparametric…

部分线性Cox模型的深度学习方法AI 解读

While deep learning approaches to survival data have demonstrated empirical success in applications, most of these methods are difficult to interpret and mathematical understanding of them is lacking. This paper studies the partially linear Cox model, where the nonlinear component of the model is implemented using a deep neural network. The proposed approach is flexible and able to circumvent the curse of dimensionality, yet it facilitates interpretability of the effects of…

能否利用 Twitter 测度通胀预期？AI 解读

Drawing on Italian tweets, we employ textual data and machine learning techniques to build new real-time measures of consumers’ inflation expectations. First, we select keywords to identify tweets related to prices and expectations thereof. Second, we build a set of daily measures of inflation expectations around the selected tweets, combining the Latent Dirichlet Allocation (LDA) with a dictionary-based approach, using manually labeled bi-grams and tri-grams. Finally, we…

用于理赔欺诈识别的可解释注意力网络AI 解读

Insurance companies must manage millions of claims per year. While most of these are not fraudulent, those that are nevertheless cost insurance companies and those they insure vast amounts of money. The ultimate goal is to develop a predictive model that can single out fraudulent claims and pay out non-fraudulent ones automatically. Health care claims have a peculiar data structure, comprising inputs of varying length and variables with a large number of categories. Both…

通过蒸馏实现快速且有力的条件随机化检验AI 解读

Summary We consider the problem of conditional independence testing: given a response $Y$ and covariates $(X,Z)$, we test the null hypothesis that $Y {\perp\!\!\!\perp} X \mid Z$. The conditional randomization test was recently proposed as a way to use distributional information about $X\mid Z$ to exactly and nonasymptotically control Type-I error using any test statistic in any dimensionality without assuming anything about $Y\mid (X,Z)$. This flexibility, in principle,…

双重机器学习下的因果中介分析AI 解读

Summary This paper combines causal mediation analysis with double machine learning for a data-driven control of observed confounders in a high-dimensional setting. The average indirect effect of a binary treatment and the unmediated direct effect are estimated based on efficient score functions, which are robust with respect to misspecifications of the outcome, mediator, and treatment models. This property is key for selecting these models by double machine learning, which…

核扩展随机神经网络AI 解读

Abstract The deep neural network suffers from many fundamental issues in machine learning. For example, it often gets trapped into a local minimum in training, and its prediction uncertainty is hard to be assessed. To address these issues, we propose the so-called kernel-expanded stochastic neural network (K-StoNet) model, which incorporates support vector regression as the first hidden layer and reformulates the neural network as a latent variable model. The former maps the…

利用Lasso进行效应修饰的选择后推断AI 解读

Abstract Effect modification occurs when the effect of the treatment on an outcome varies according to the level of other covariates and often has important implications in decision-making. When there are tens or hundreds of covariates, it becomes necessary to use the observed data to select a simpler model for effect modification and then make valid statistical inference. We propose a two-stage procedure to solve this problem. First, we use Robinson's transformation to…