Abstract
In discourse, entities that are discontinuous with the current storyline are seen as cues for an event boundary, as they
are too irregular to be mapped to the existing scene. However, some instances of discontinuity can maintain coherency,
as exemplified in Calvin & Hobbes comics, where visual discontinuities can be resolved by the understanding that they
depict Calvin’s imagination rather than actual events. This requires the reconciliation of the original storyworld domain
with a private, mental domain (the alternative). In our first experiment, we examined whether switching between domains and/or the nature of the presented domain(s) incurred processing costs. Our second experiment examined whether
physical cues such as the contours between the discontinuous entities facilitated processing. The results indicate that
switching domains is indeed more costly, despite still being understood as congruous sequences. Moreover, strong similarity in contours aided readers with greater comics proficiency. Overall, our results show that the processing of visual
narratives extends beyond mere event understanding and is not universally transparent.
are too irregular to be mapped to the existing scene. However, some instances of discontinuity can maintain coherency,
as exemplified in Calvin & Hobbes comics, where visual discontinuities can be resolved by the understanding that they
depict Calvin’s imagination rather than actual events. This requires the reconciliation of the original storyworld domain
with a private, mental domain (the alternative). In our first experiment, we examined whether switching between domains and/or the nature of the presented domain(s) incurred processing costs. Our second experiment examined whether
physical cues such as the contours between the discontinuous entities facilitated processing. The results indicate that
switching domains is indeed more costly, despite still being understood as congruous sequences. Moreover, strong similarity in contours aided readers with greater comics proficiency. Overall, our results show that the processing of visual
narratives extends beyond mere event understanding and is not universally transparent.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the Annual Meeting of the Cognitive Science Society |
| Volume | 44 |
| Publication status | Published - 2022 |
| Event | Annual meeting of the Cognitive Science Society - Duration: 27 Jul 2022 → 30 Jul 2022 |
Conference
| Conference | Annual meeting of the Cognitive Science Society |
|---|---|
| Period | 27/07/22 → 30/07/22 |
Keywords
- blending
- discontinuity
- rhyme
- visual narratives