Surprise! Evaluating AI’s ability to tell surprising stories
.txtLAB @ McGill 2025-06-22
Summary:
In a new paper lead-authored by Anneliese Bissell and Ella Paulin and presented at the 2025 Workshop on Narrative Understanding, we introduce a novel framework for evaluating narrative surprise in stories produced by large language models (LLMs), grounding our approach in psychological theories of storytelling and reader response. As theorists like Brewer, Lichtenstein, and Ortony have argued,…