A Note on Distributed Quantile Regression by Pilot Sampling and One-Step Updating
先导抽样与一步更新的分布式分位数回归札记
Quantile regression is a method of fundamental importance. How to efficiently conduct quantile regression for a large dataset on a distributed system is of great importance. We show that the popularly used one-shot estimation is statistically inefficient if data are not randomly distributed across different workers. To fix the problem, a novel one-step estimation method is developed with the following nice properties. First, the algorithm is communication efficient. That is…