Branch Scaling Manifests as Implicit Architectural Regularization for Improving Generalization in Overparameterized ResNets
残差分支缩放作为隐式架构正则化改善过参数化 ResNet 的泛化
Scaling factors in residual branches have emerged as a prevalent method for boosting neural network performance, especially in normalization-free architectures. While prior work has primarily examined scaling effects from an optimization perspective, this paper investigates their role in residual architectures through the lens of generalization theory. Specifically, we establish that wide residual networks (ResNets) with constant scaling factors become asymptotically…