Boosting With the L 2 Loss
采用平方损失的提升方法AI 解读 ↓
← 返回论文列表与筛选
阅读说明
本页整理公开书目信息，不生成学术质量评分。AI 解读根据题名及所注明的摘要或原文片段生成，未完成全文核验，可能有误；具体假设、证明与结论请核对原文。摘要保留来源文本，未经模型改写。
DOI 首次登记不等于接收或发表日期。部分更正、评论等条目没有独立摘要；缺少可靠材料时保留待补状态。
引用量采用 OpenAlex 单条关联记录，不合计多个记录；关联记录可能包含正式发表版本，不等于此版本单独引用。缺失不视为零，引用指标不代表论文质量。
关注作者按书目中的完整姓名匹配，同名和姓名变体需人工辨别。相关论文先按共享细分方向和具体方法排列，再参考通用方法与发表日期。
分类依据与纠错
AI 根据所提供的论文材料归类：摘要属于通用回归与分类学习理论，未涉及时间序列预测或金融收益预测等具体方向。
反馈分类问题
正在核对关联版本…
代码、数据与补充材料
正在核对对应版本的资源…
关注这篇论文的作者
采用平方损失的提升方法
- 研究问题
- 以平方损失构造的迭代提升如何控制回归与分类中的偏差和复杂度，并在未知平滑性或高维预测变量下发挥作用？
- 方法与思路
- 作者从函数梯度下降构造 L2Boost，分析对称线性学习器的残差重拟合，将迭代次数作为平滑或正则化参数。
- 材料陈述的贡献
- 摘要称，发现指数型偏差—方差权衡，证明样条学习器的最优收敛率与平滑性适应，并用实验展示高维应用表现。
- 阅读关注点
- 应核对线性学习器与样条的理论条件、迭代停止规则，以及分类中决策边界分析与回归偏差—方差分解的差异。
- 阅读边界
- 仅据版本未注明的 OpenAlex 摘要；具体速率、停止规则和实验细节未说明，不能将所述优势推广到所有学习器。
原文摘要
This article investigates a computationally simple variant of boosting, L2Boost, which is constructed from a functional gradient descent algorithm with the L2-loss function. Like other boosting algorithms, L2Boost uses many times in an iterative fashion a prechosen fitting method, called the learner. Based on the explicit expression of refitting of residuals of L2Boost, the case with (symmetric) linear learners is studied in detail in both regression and classification. In particular, with the boosting iteration m working as the smoothing or regularization parameter, a new exponential bias-variance trade-off is found with the variance (complexity) term increasing very slowly as m tends to infinity. When the learner is a smoothing spline, an optimal rate of convergence result holds for both regression and classification and the boosted smoothing spline even adapts to higher-order, unknown smoothness. Moreover, a simple expansion of a (smoothed) 0–1 loss function is derived to reveal the importance of the decision boundary, bias reduction, and impossibility of an additive bias-variance decomposition in classification. Finally, simulation and real dataset results are obtained to demonstrate the attractiveness of L2Boost. In particular, we demonstrate that L2Boosting with a novel component-wise cubic smoothing spline is both practical and effective in the presence of high-dimensional predictors.