Consistent Nonparametric Regression

研究问题: 给定取值于 $\mathbb{R}^d$ 的 $X$ 与取值于 $\mathbb{R}^{d'}$ 的 $Y$ ，如何用随机样本非参数地估计条件分布 $P^Y(\bullet \mid X)$ ，并由此得到条件期望、方差、协方差、相关系数、分位数以及预测和多重分类中近似 Bayes 规则的一致估计？
方法与思路: 用权函数构造估计 $\hat{P}_n^Y(A \mid X)=\sum_{i=1}^n W_{ni}(X)I_A(Y_i)$，其中权重可依赖样本。定义权函数序列的一致性，给出充分条件；对概率权函数（非负且权重和为 1）证明这些条件既充分又必要，并构造基于最近邻的一致概率权函数序列。
摘要陈述的贡献: 摘要明确给出：建立权函数序列一致性的定义与充分条件；对概率权函数证明条件充要；构造最近邻一致概率权函数序列；将结果用于验证条件期望、方差、协方差、标准差、相关、分位数估计以及近似 Bayes 规则 Bayes 风险的一致性。
预备知识: 建议先掌握：条件分布与条件期望的定义；非参数回归与核/最近邻估计的基本思想；概率权函数（非负且和为 1）的含义；几乎处处收敛、依概率收敛等一致性概念；Bayes 风险与多重分类的基本框架。
阅读重点: 阅读时重点核对：一致性定义的具体收敛模式；充分条件与必要性证明中关于权函数、样本和 $X$ 的假设；最近邻权函数构造如何满足这些条件；将条件分布估计结果推广到期望、方差、分位数和 Bayes 规则时所需的额外条件。
阅读边界: 基于原文摘要，未阅读全文。摘要未给出具体定理编号、证明细节、数据示例或数值结果；上述方法概述与阅读建议不替代原文的假设与推导。

DeepSeek Flash · 2026-09-30 · 摘要解读

原文摘要

Let $(X, Y)$ be a pair of random variables such that $X$ is $\mathbb{R}^d$-valued and $Y$ is $\mathbb{R}^{d'}$-valued. Given a random sample $(X_1, Y_1), \cdots, (X_n, Y_n)$ from the distribution of $(X, Y)$, the conditional distribution $P^Y(\bullet \mid X)$ of $Y$ given $X$ can be estimated nonparametrically by $\hat{P}_n^Y(A \mid X) = \sum^n_1 W_{ni}(X)I_A(Y_i)$, where the weight function $W_n$ is of the form $W_{ni}(X) = W_{ni}(X, X_1, \cdots, X_n), 1 \leqq i \leqq n$. The weight function $W_n$ is called a probability weight function if it is nonnegative and $\sum^n_1 W_{ni}(X) = 1$. Associated with $\hat{P}_n^Y(\bullet \mid X)$ in a natural way are nonparametric estimators of conditional expectations, variances, covariances, standard deviations, correlations and quantiles and nonparametric approximate Bayes rules in prediction and multiple classification problems. Consistency of a sequence $\{W_n\}$ of weight functions is defined and sufficient conditions for consistency are obtained. When applied to sequences of probability weight functions, these conditions are both necessary and sufficient. Consistent sequences of probability weight functions defined in terms of nearest neighbors are constructed. The results are applied to verify the consistency of the estimators of the various quantities discussed above and the consistency in Bayes risk of the approximate Bayes rules.

摘要来源：OpenAlex

正在读取解读与摘要…

笔记与分组

查找这个方法的新论文 →

一致的非参数回归

研究问题

给定取值于

\mathbb{R}^d

的

X

与取值于

\mathbb{R}^{d'}

的

Y

，如何用随机样本非参数地估计条件分布

P^Y(\bullet \mid X)

，并由此得到条件期望、方差、协方差、相关系数、分位数以及预测和多重分类中近似 Bayes 规则的一致估计？

方法与思路

用权函数构造估计

\hat{P}_n^Y(A \mid X)=\sum_{i=1}^n W_{ni}(X)I_A(Y_i)

，其中权重可依赖样本。定义权函数序列的一致性，给出充分条件；对概率权函数（非负且权重和为 1）证明这些条件既充分又必要，并构造基于最近邻的一致概率权函数序列。用权函数构造估计 $\hat{P}_n^Y(A \mid X)=\sum_{i=1}^n W_{ni}(X)I_A(Y_i)$，其中权重可依赖样本。定义权函数序列的一致性，给出充分条件；对概率权函数（非负且权重和为 1）证明这些条件既充分又必要，并构造基于最近邻的一致概率权函数序列。

摘要陈述的贡献

摘要明确给出：建立权函数序列一致性的定义与充分条件；对概率权函数证明条件充要；构造最近邻一致概率权函数序列；将结果用于验证条件期望、方差、协方差、标准差、相关、分位数估计以及近似 Bayes 规则 Bayes 风险的一致性。

预备知识

建议先掌握：条件分布与条件期望的定义；非参数回归与核/最近邻估计的基本思想；概率权函数（非负且和为 1）的含义；几乎处处收敛、依概率收敛等一致性概念；Bayes 风险与多重分类的基本框架。

阅读重点

阅读时重点核对：一致性定义的具体收敛模式；充分条件与必要性证明中关于权函数、样本和

X

的假设；最近邻权函数构造如何满足这些条件；将条件分布估计结果推广到期望、方差、分位数和 Bayes 规则时所需的额外条件。

阅读边界

基于原文摘要，未阅读全文。摘要未给出具体定理编号、证明细节、数据示例或数值结果；上述方法概述与阅读建议不替代原文的假设与推导。

DeepSeek Flash · 2026-09-30 · 摘要解读

原文摘要

Let

(X, Y)

be a pair of random variables such that

X

\mathbb{R}^d

-valued and

Y

\mathbb{R}^{d'}

-valued. Given a random sample

(X_1, Y_1), \cdots, (X_n, Y_n)

from the distribution of

(X, Y)

, the conditional distribution

P^Y(\bullet \mid X)

Y

given

X

can be estimated nonparametrically by

\hat{P}_n^Y(A \mid X) = \sum^n_1 W_{ni}(X)I_A(Y_i)

, where the weight function

W_n

is of the form

W_{ni}(X) = W_{ni}(X, X_1, \cdots, X_n), 1 \leqq i \leqq n

. The weight function

W_n

is called a probability weight function if it is nonnegative and

\sum^n_1 W_{ni}(X) = 1

. Associated with

\hat{P}_n^Y(\bullet \mid X)

in a natural way are nonparametric estimators of conditional expectations, variances, covariances, standard deviations, correlations and quantiles and nonparametric approximate Bayes rules in prediction and multiple classification problems. Consistency of a sequence

\{W_n\}

of weight functions is defined and sufficient conditions for consistency are obtained. When applied to sequences of probability weight functions, these conditions are both necessary and sufficient. Consistent sequences of probability weight functions defined in terms of nearest neighbors are constructed. The results are applied to verify the consistency of the estimators of the various quantities discussed above and the consistency in Bayes risk of the approximate Bayes rules.Let $(X, Y)$ be a pair of random variables such that $X$ is $\mathbb{R}^d$-valued and $Y$ is $\mathbb{R}^{d'}$-valued. Given a random sample $(X_1, Y_1), \cdots, (X_n, Y_n)$ from the distribution of $(X, Y)$, the conditional distribution $P^Y(\bullet \mid X)$ of $Y$ given $X$ can be estimated nonparametrically by $\hat{P}_n^Y(A \mid X) = \sum^n_1 W_{ni}(X)I_A(Y_i)$, where the weight function $W_n$ is of the form $W_{ni}(X) = W_{ni}(X, X_1, \cdots, X_n), 1 \leqq i \leqq n$. The weight function $W_n$ is called a probability weight function if it is nonnegative and $\sum^n_1 W_{ni}(X) = 1$. Associated with $\hat{P}_n^Y(\bullet \mid X)$ in a natural way are nonparametric estimators of conditional expectations, variances, covariances, standard deviations, correlations and quantiles and nonparametric approximate Bayes rules in prediction and multiple classification problems. Consistency of a sequence $\{W_n\}$ of weight functions is defined and sufficient conditions for consistency are obtained. When applied to sequences of probability weight functions, these conditions are both necessary and sufficient. Consistent sequences of probability weight functions defined in terms of nearest neighbors are constructed. The results are applied to verify the consistency of the estimators of the various quantities discussed above and the consistency in Bayes risk of the approximate Bayes rules.

摘要来源：OpenAlex