Large Scale Prediction with Decision Trees

This article shows that decision trees constructed with Classification and Regression Trees (CART) and C4.5 methodology are consistent for regression and classification tasks, even when the number of predictor variables grows sub-exponentially with the sample size, under natural 0-norm and 1-norm sparsity constraints. The theory applies to a wide range of models, including (ordinary or logistic) additive regression models with component functions that are continuous, of bounded variation, or, more generally, Borel measurable. Consistency holds for arbitrary joint distributions of the predictor variables, thereby accommodating continuous, discrete, and/or dependent data. Finally, we show that these qualitative properties of individual trees are inherited by Breiman’s random forests. A key step in the analysis is the establishment of an oracle inequality, which allows for a precise characterization of the goodness of fit and complexity tradeoff for a mis-specified model. Supplementary materials for this article are available online.

摘要来源：OpenAlex 索引摘要（稿件版本未注明）

笔记与分组

同方向的基础文献

相关领域论文

共同方法：高维与机器学习、机器学习与 DML

Sharp Asymptotic Theory of Maximum Likelihood Estimation for Gaussian Processes with an RBF Kernel

Ameer Qaqish · Sudipto Banerjee · Didong Li首次提交 2026-10-07 · 修订 2026-10-13 · v2arXiv预印本

RBF 核高斯过程最大似然估计的精确渐近理论AI 解读

Gaussian processes (GPs) are widely used across machine learning, spatial statistics, time-series analysis, optimization, Bayesian statistics, and scientific applications. A central component of a GP model is its kernel, which is typically specified through a parametric family. Among the most widely used choices is the radial basis function (RBF), also known as the squared exponential or Gaussian kernel, owing to its simple form, smoothness, and flexibility. In practice, the…

核、筛与局部多项式极大与准极大似然时间序列

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、机器学习与 DML

An Infinite BART model

Marco Battiston · Yu Luo首次提交 2025-11-25 · 修订 2026-10-13 · v2arXiv预印本

Bayesian additive regression trees (BART) is a popular Bayesian ensemble model used in regression and classification analysis. Under this modeling framework, the regression function is approximated by an ensemble of decision trees, interpreted as weak learners. In this work, we propose a generalization of the BART model that has two main features: first, it automatically selects the number of decision trees using the given data; second, the model allows clusters of…

微观 · 因果推断贝叶斯机器学习与 DML

关联记录被引 0 次 ↗OpenAlex · 核验 2026-10-01

阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、机器学习与 DML

Assumption-Lean Differential Variance Inference for Heterogeneous Treatment Effect Detection

Philippe A. Boileau · Hani Zaki · Gabriele Lileikyte · Niklas Nielsen · Patrick R. Lawler 等 6 位作者首次提交 2025-12-02 · 修订 2026-10-13 · v5arXiv预印本

The conditional average treatment effect (CATE) is frequently estimated in clinical studies to refute a homogeneous treatment effect hypothesis. Under this regime, all patients making up the population experience identical benefit from a given treatment relative to a comparator. Uncovering heterogeneous treatment effects through inference about the CATE, however, requires that covariates truly modifying the treatment effect be reliably collected at baseline. CATE-based…

微观 · 因果推断机器学习与 DML 微观 · 分位数与分布效应

关联记录被引 0 次 ↗OpenAlex · 核验 2026-10-01

阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、机器学习与 DML

When Sample-Splitting Choices Matter in TMLE and AIPW: Cross-Fitting, Targeting, and Repetition

M. Ehsan Karim · Rainie Fu首次提交 2026-10-12 · 修订 2026-10-12 · v1arXiv预印本

TMLE 与 AIPW 中样本分割选择何时重要：交叉拟合、目标化与重复AI 解读

Variants of targeted maximum likelihood estimation (TMLE) and augmented inverse-probability weighting (AIPW) with machine-learning nuisance models differ in which observations train them, how bias is corrected, and whether splits are repeated. In known-truth simulations of a binary-outcome average treatment effect, eight headline estimators shared each setting's library, inner folds and truncation bound; coverage differences were judged against a prespecified…

微观 · 因果推断机器学习与 DML 极大与准极大似然

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、机器学习与 DML

Recurrent Neural Networks for Forecasting Autoregressive Noncausal Processes

Joann Jasiak · Cheng Zhong首次提交 2026-10-11 · 修订 2026-10-11 · v1arXiv预印本

用循环神经网络预测自回归非因果过程AI 解读

This paper examines the use of recurrent neural networks and their extensions for forecasting autoregressive causal-noncausal processes, characterized by local explosive patterns such as bubbles and spikes. We study the recurrent neural networks (RNN), long short-term memory networks (LSTM), gated recurrent unit (GRU), bidirectional LSTM, and also a simple feed-forward network (FNN) to reveal the difficulty of forecasting extreme values depending on the type of network and…

宏观 · 时间序列机器学习与 DML 因果推断

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓

共同方法：高维与机器学习、机器学习与 DML

Interconnections in Clinical Treatment Measures at the Pan-Disease Level: A Deep Neural Network Analysis of SEER-Medicare

Jiping Wang · Tong Wang · Shuangge Ma上线 2026-10-09Journal of the American Statistical Association在线待刊

跨疾病临床治疗指标的关联：基于 SEER-Medicare 的深度神经网络分析AI 解读

In outcomes research, clinical treatment measures are routinely analyzed. Most existing studies focus on individual diseases, and increasing recent evidence suggests that clinical treatment measures of different diseases can be “correlated” (or interconnected). Existing studies on such interconnections are usually limited to a small number of diseases. In this study, for U.S. older patients with common cancers, we complement the existing literature and conduct a pan-disease…

机器学习与 DML 正则化与变量选择

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓