Fake Date Tests: Can We Trust In-sample Accuracy of LLMs in Macroeconomic Forecasting?
伪日期检验:大语言模型宏观预测的样本内准确性可信吗?
Large language models (LLMs) are a type of machine learning tool that economists have started to apply in their empirical research. One such application is macroeconomic forecasting with backtesting of LLMs, even though they are trained on the same data that is used to estimate their forecasting performance. Can these in-sample accuracy results be extrapolated to the model's out-of-sample performance? To answer this question, we developed a family of prompt sensitivity tests…