Transfer learning for nonparametric classification: Minimax rate and adaptive classifier

Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper, we study transfer learning in the context of nonparametric classification based on observations from different distributions under the posterior drift model, which is a general framework and arises in many practical problems. We first establish the minimax rate of convergence and construct a rate-optimal two-sample weighted $K$ -NN classifier. The results characterize precisely the contribution of the observations from the source distribution to the classification task under the target distribution. A data-driven adaptive classifier is then proposed and is shown to simultaneously attain within a logarithmic factor of the optimal rate over a large collection of parameter spaces. Simulation studies and real data applications are carried out where the numerical results further illustrate the theoretical analysis. Extensions to the case of multiple source distributions are also considered.Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper, we study transfer learning in the context of nonparametric classification based on observations from different distributions under the posterior drift model, which is a general framework and arises in many practical problems. We first establish the minimax rate of convergence and construct a rate-optimal two-sample weighted $K$-NN classifier. The results characterize precisely the contribution of the observations from the source distribution to the classification task under the target distribution. A data-driven adaptive classifier is then proposed and is shown to simultaneously attain within a logarithmic factor of the optimal rate over a large collection of parameter spaces. Simulation studies and real data applications are carried out where the numerical results further illustrate the theoretical analysis. Extensions to the case of multiple source distributions are also considered.

摘要来源：OpenAlex 索引摘要（稿件版本未注明）

笔记与分组

同方向的基础文献

相关领域论文

共同方法：半参数与非参数、贝叶斯、一般估计

A longitudinal Bayesian framework for estimating causal dose-response relationships

Yu Luo · Kuan Liu · Ramandeep Singh · Daniel J. Graham首次提交 2025-05-27 · 修订 2026-10-13 · v5arXiv预印本

估计纵向因果剂量反应关系的贝叶斯框架AI 解读

Existing causal methods for time-varying exposure and time-varying confounding focus on estimating the average causal effect of a time-varying binary treatment on an end-of-study outcome, offering limited tools for characterizing marginal causal dose-response relationships under continuous exposures. We propose a scalable, nonparametric Bayesian framework for estimating marginal longitudinal causal dose-response functions with repeated outcome measurements. Our approach…

微观 · 因果推断面板数据贝叶斯

关联记录被引 0 次 ↗OpenAlex · 核验 2026-10-14

作者提供的期刊信息 ↗

AI 解读阅读原文 ↗BibTeX ↓

共同方法：半参数与非参数、贝叶斯、一般估计

Sharp Asymptotic Theory of Maximum Likelihood Estimation for Gaussian Processes with an RBF Kernel

Ameer Qaqish · Didong Li首次提交 2026-10-07 · 修订 2026-10-07 · v1arXiv预印本

RBF 核高斯过程最大似然估计的精确渐近理论AI 解读

Gaussian processes (GPs) are widely used across machine learning, spatial statistics, time-series analysis, optimization, Bayesian statistics, and scientific applications. A central component of a GP model is its kernel, which is typically specified through a parametric family. Among the most widely used choices is the radial basis function (RBF), also known as the squared exponential or Gaussian kernel, owing to its simple form, smoothness, and flexibility. In practice, the…

核、筛与局部多项式极大与准极大似然时间序列

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓

共同方法：半参数与非参数、贝叶斯、一般估计

Bayesian Operator Learning: Posterior Existence and Convergence of Point Estimates for Gaussian Priors

Niklas Reinhardt · Jakob Zech首次提交 2026-10-02 · 修订 2026-10-02 · v1arXiv预印本

贝叶斯算子学习：高斯先验下后验存在性与点估计收敛AI 解读

We develop a Bayesian framework for learning nonlinear operators between infinite-dimensional spaces. Given a map $g_0:\mathcal{X}\to\mathcal{Y}$ between separable Hilbert spaces, we study the recovery of $g_0$ from $n\in\mathbb{N}$ noisy input-output pairs $(\boldsymbol{X},\boldsymbol{Z})=(X_i,Z_i)_{i=1}^n$ with $Z_i= g_0 (X_i ) + E_i$. Here the $X_i\in\mathcal{X}$ are randomly drawn 'design' points in a compact subset of $\mathcal X$, and the $E_i$ are assumed to be i.i.d.…

贝叶斯核、筛与局部多项式正则化与变量选择

关联记录被引 0 次 ↗OpenAlex · 核验 2026-10-07

AI 解读阅读原文 ↗BibTeX ↓

共同方法：半参数与非参数、贝叶斯、一般估计

A Residual Tree Gaussian Process Modeling Framework for High-Dimensional Data

Pulong Ma · Li Ma首次提交 2026-10-02 · 修订 2026-10-02 · v1arXiv预印本

面向高维数据的残差树高斯过程建模框架AI 解读

With the advance of measurement technologies and increasing computing power, large spatial data with heterogeneous structures are often collected over high-dimensional domains. Existing Gaussian process (GP) models and computational strategies are often inadequate for analyzing such datasets in multi-dimensional domains. To address these challenges, we develop a Bayesian residual tree GP methodology called ResTGP for large spatial data with potentially heterogeneous…

高维与机器学习空间与网络半参数与非参数

关联记录被引 0 次 ↗OpenAlex · 核验 2026-10-07

作者发表记录：Pulong Ma · 作者引用 222 · Journal of the American Statistical Association ↗查看依据

AI 解读阅读原文 ↗BibTeX ↓

共同方法：半参数与非参数、贝叶斯、一般估计

Data assimilation with the 2D Navier–Stokes equations: Optimal Gaussian asymptotics for the posterior measure

Dimitri Konen · Richard Nickl刊期 2026-10-01 · 卷 54（5）The Annals of Statistics已编入正刊

二维 Navier–Stokes 方程的数据同化：后验测度的最优高斯渐近性质AI 解读

A functional Bernstein–von Mises theorem is proved for posterior measures arising in a data assimilation problem with the two-dimensional Navier–Stokes equation where a Gaussian process prior is assigned to the initial condition of the system. The posterior measure, which provides the update in the space of all trajectories arising from a discrete sample of the (deterministic) dynamics, is shown to be approximated by a Gaussian random vector field obtained as the solution to…

贝叶斯半参数与非参数

被引 0 次 ↗OpenAlex · 核验 2026-10-04

AI 解读阅读原文 ↗BibTeX ↓

共同方法：半参数与非参数、贝叶斯、一般估计

Is the treatment beneficial? Causal Inference with Ordinal Outcomes: A Bayesian Solution

Rituparna Dey · Tirthankar Dasgupta首次提交 2026-07-25 · 修订 2026-09-28 · v2arXiv预印本

处理是否有益？有序结局因果推断的贝叶斯方法AI 解读

Randomized experiments with ordinal outcomes are common across scientific applications, but conventional causal estimands such as the average treatment effect are difficult to interpret because ordinal categories lack meaningful numerical spacing. Two interpretable estimands, the probabilities that the treatment is beneficial and strictly beneficial, depend on the joint distribution of the potential outcomes and are therefore not identifiable from observed data. The sharp…

微观 · 因果推断贝叶斯半参数与非参数

被引：暂无数据

AI 解读阅读原文 ↗BibTeX ↓