Minimizing Type 2 Errors in an Experiment-Rich Regime via Optimal Resource Allocation
实验密集环境下通过最优资源配置降低第二类错误
Randomized experiments (often known as "A/B tests") are widely used to evaluate product and service innovations. We study how to allocate limited experimentation resources across M concurrent experiments in an experiment-rich regime. Existing work on allocation has predominantly focused on minimizing the worst-case mean squared error (MSE) of estimated treatment effects, which favors experiments with larger (and typically unknown) outcome variance. While appropriate for…