Choosing the Better Bandit Algorithm under Data Sharing: When Do A/B Experiments Work?
数据共享下如何选择更好的老虎机算法:A/B 实验何时有效?
We study A/B experiments that are designed to compare the performance of two recommendation algorithms. Prior work has observed that the stable unit treatment value assumption (SUTVA) often does not hold in large-scale recommendation systems, and hence the estimate for the global treatment effect (GTE) is biased. Specifically, units under the treatment and control algorithms contribute to a shared pool of data that subsequently train both algorithms, resulting in…