Validating language models as study participants: How it’s being done, why it fails, and what works instead

Statistical Modeling, Causal Inference, and Social Science 2025-12-19

Summary:

This is Jessica. Earlier this year, I started paying attention to proposals to use LLMs to simulate participants in surveys and behavioral experiments. The idea is that LLMs can be prompted with experiment or survey instructions and a participant persona … Continue reading

Link:

https://statmodeling.stat.columbia.edu/2025/12/19/validating-language-models-as-study-participants-how-its-being-done-why-it-fails-and-what-works-instead/

From feeds:

Statistics and Visualization » Statistical Modeling, Causal Inference, and Social Science

Tags:

miscellaneous

Authors:

Jessica Hullman

Date tagged:

12/19/2025, 17:52

Date published:

12/19/2025, 11:57