An electrophysiological investigation of co-referential processes in visual narrative comprehension

Cas W. Coopmans*, Neil Cohn

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

6 Citations (Scopus)

Abstract

Visual narratives make use of various means to convey referential and co-referential meaning, so comprehenders must recognize that different depictions across sequential images represent the same character(s). In this study, we investigated how the order in which different types of panels in visual sequences are presented affects how the unfolding narrative is comprehended. Participants viewed short comic strips while their electroencephalogram (EEG) was recorded. We analyzed evoked and induced EEG activity elicited by both full panels (showing a full character) and refiner panels (showing only a zoom of that full panel), and took into account whether they preceded or followed the panel to which they were co-referentially related (i.e., were cataphoric or anaphoric). We found that full panels elicited both larger N300 amplitude and increased gamma-band power compared to refiner panels. Anaphoric panels elicited a sustained negativity compared to cataphoric panels, which appeared to be sensitive to the referential status of the anaphoric panel. In the time-frequency domain, anaphoric panels elicited reduced 8-12 Hz alpha power and increased 45-65 Hz gamma-band power compared to cataphoric panels. These findings are consistent with models in which the processes involved in visual narrative comprehension partially overlap with those in language comprehension.

Original languageEnglish
Article number108253
Pages (from-to)1-13
Number of pages13
JournalNeuropsychologia
Volume172
DOIs
Publication statusPublished - 29 Jul 2022

Keywords

  • Comics
  • Anaphora
  • ERPs
  • Oscillations
  • Nref
  • Alpha
  • GAMMA-Band Activity
  • working Memory
  • Language Comprehension
  • Neural Oscillation
  • THETA-REsponses
  • Human Brain
  • ALPHA-Band
  • Discours
  • Retrieval
  • Event-related Potential

Fingerprint

Dive into the research topics of 'An electrophysiological investigation of co-referential processes in visual narrative comprehension'. Together they form a unique fingerprint.

Cite this