Announcing NARRABENCH: A New Framework for Testing Narrative Intelligence in Language Models

In our new paper, NARRABENCH: A Comprehensive Framework for Narrative Benchmarking, we (Sil Hamilton, Matthew Wilkens, and Andrew Piper) introduce the first systematic framework for evaluating narrative understanding in AI. Drawing on decades of narrative theory, NARRABENCH defines four foundational dimensions of storytelling—story, narration, discourse, and situatedness—and maps fifty specific narrative skills that large language models should…