TY - JOUR
T1 - Individual differences in the neural dynamics of visual narrative comprehension
T2 - The effects of proficiency and age of acquisition
AU - Coderre, Emily L. L.
AU - Cohn, Neil
N1 - © 2023. The Author(s).
PY - 2023/8/14
Y1 - 2023/8/14
N2 - Understanding visual narrative sequences, as found in comics, is known to recruit similar cognitive mechanisms to verbal language. As measured by event-related potentials (ERPs), these manifest as initial negativities (N400, LAN) and subsequent positivities (P600). While these components are thought to index discrete processing stages, they differentially arise across participants for any given stimulus. In language contexts, proficiency modulates brain responses, with smaller N400 effects and larger P600 effects appearing with increasing proficiency. In visual narratives, recent work has also emphasized the role of proficiency in neural response patterns. We thus explored whether individual differences in proficiency modulate neural responses to visual narrative sequencing in similar ways as in language. We combined ERP data from 12 studies examining semantic and/or grammatical processing of visual narrative sequences. Using linear mixed effects modeling, we demonstrate differential effects of visual language proficiency and "age of acquisition" on N400 and P600 responses. Our results align with those reported in language contexts, providing further evidence for the similarity of linguistic and visual narrative processing, and emphasize the role of both proficiency and age of acquisition in visual narrative comprehension.
AB - Understanding visual narrative sequences, as found in comics, is known to recruit similar cognitive mechanisms to verbal language. As measured by event-related potentials (ERPs), these manifest as initial negativities (N400, LAN) and subsequent positivities (P600). While these components are thought to index discrete processing stages, they differentially arise across participants for any given stimulus. In language contexts, proficiency modulates brain responses, with smaller N400 effects and larger P600 effects appearing with increasing proficiency. In visual narratives, recent work has also emphasized the role of proficiency in neural response patterns. We thus explored whether individual differences in proficiency modulate neural responses to visual narrative sequencing in similar ways as in language. We combined ERP data from 12 studies examining semantic and/or grammatical processing of visual narrative sequences. Using linear mixed effects modeling, we demonstrate differential effects of visual language proficiency and "age of acquisition" on N400 and P600 responses. Our results align with those reported in language contexts, providing further evidence for the similarity of linguistic and visual narrative processing, and emphasize the role of both proficiency and age of acquisition in visual narrative comprehension.
KW - Age of acquisition
KW - Comics
KW - Event-related potentials
KW - Proficiency
KW - Visual language
KW - Visual narratives
UR - http://www.scopus.com/inward/record.url?scp=85168277650&partnerID=8YFLogxK
U2 - 10.3758/s13423-023-02334-x
DO - 10.3758/s13423-023-02334-x
M3 - Review article
C2 - 37578688
SN - 1069-9384
VL - 31
SP - 89
EP - 103
JO - Psychonomic Bulletin & Review
JF - Psychonomic Bulletin & Review
IS - 1
ER -