The pieces fit: Constituent structure and global coherence of visual narrative in RSVP

Carl Erick Hagmann*, Neil Cohn

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

9 Citations (Scopus)

Abstract

Recent research has shown that comprehension of visual narrative relies on the ordering and timing of sequential images. Here we tested if rapidly presented 6-image long visual sequences could be understood as coherent narratives. Half of the sequences were correctly ordered and half had two of the four internal panels switched. Participants reported whether the sequence was correctly ordered and rated its coherence. Accuracy in detecting a switch increased when panels were presented for 1 s rather than 0.5 s. Doubling the duration of the first panel did not affect results. When two switched panels were further apart, order was discriminated more accurately and coherence ratings were low, revealing that a strong local adjacency effect influenced order and coherence judgments. Switched panels at constituent boundaries or within constituents were most disruptive to order discrimination, indicating that the preservation of constituent structure is critical to visual narrative grammar. (C) 2016 Elsevier B.V. All rights reserved.

Original languageEnglish
Pages (from-to)157-164
Number of pages8
JournalActa Psychologica
Volume164
DOIs
Publication statusPublished - Feb 2016
Externally publishedYes

Keywords

  • Visual language
  • Comics
  • Constituent structure
  • Visual cognition
  • Narrative
  • RSVP
  • SEQUENTIAL IMAGE COMPREHENSION
  • LANGUAGE COMPREHENSION
  • BRAIN
  • PICTURES
  • MEMORY
  • POTENTIALS
  • EVENTS
  • MUSIC

Cite this