Asymptotic Theory for IV-Based Reinforcement Learning with Potential Endogeneity
潜在内生性下工具变量强化学习的渐近理论
In the standard data analysis framework, data is collected (once and for all), and then data analysis is carried out. However, with the advancement of digital technology, decision-makers constantly analyze past data and generate new data through their decisions. We model this as a Markov decision process and show that the dynamic interaction between data generation and data analysis leads to a new type of bias -- reinforcement bias -- that exacerbates the endogeneity problem…