Should we trust web-scraped data?
我们应当信任网页抓取数据吗?
The increasing adoption of econometric and machine-learning approaches by empirical researchers has led to a widespread use of one data collection method: web scraping. Web scraping refers to the use of automated computer programs to access websites and download their content. The key argument of this paper is that naïve web scraping procedures can lead to sampling bias in the collected data. This article describes three sources of sampling bias in web-scraped data. More…