Aligning Language Models with Observational Data: Opportunities and Risks from a Causal Perspective
利用观测数据对齐语言模型:因果视角下的机会与风险
Large language models are being widely used across industries to generate text that contributes directly to key performance metrics, such as medication adherence in patient messaging and conversion rates in content generation. Pretrained models, however, often fall short when it comes to aligning with human preferences or optimizing for business objectives. As a result, fine-tuning with good-quality labeled data is essential to guide models to generate content that achieves…