AssistedDS: Benchmarking How External Domain Knowledge Assists LLMs in Automated Data Science
AssistedDS:外部领域知识辅助大语言模型自动数据科学的评测
Large language models (LLMs) have advanced the automation of data science workflows. Yet it remains unclear whether they can critically leverage external domain knowledge as human data scientists do in practice. To answer this question, we introduce AssistedDS (Assisted Data Science), a benchmark designed to systematically evaluate how LLMs handle domain knowledge in tabular prediction tasks. AssistedDS features both synthetic datasets with explicitly known generative…