Prediction, events, and the advantage of agents

the processing of semantic roles in visual narrative

Neil Cohn, Martin Paczynski

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Agents consistently appear prior to Patients in sentences, manual signs, and drawings, and Agents are responded to faster when presented in visual depictions of events. We hypothesized that this "Agent advantage" reflects Agents' role in event structure. We investigated this question by manipulating the depictions of Agents and Patients in preparatory actions in wordless visual narratives. We found that Agents elicited a greater degree of predictions regarding upcoming events than Patients, that Agents are viewed longer than Patients, independent of serial order, and that visual depictions of actions are processed more quickly following the presentation of an Agent vs. a Patient. Taken together these findings support the notion that Agents initiate the building of event representation. We suggest that Agent First orders facilitate the interpretation of events as they unfold and that the saliency of Agents within visual representations of events is driven by anticipation of upcoming events.

Original languageEnglish
Pages (from-to)73-97
Number of pages25
JournalCognitive Psychology
Volume67
Issue number3
DOIs
Publication statusPublished - Nov 2013
Externally publishedYes

Fingerprint

Semantics
semantics
Proxy
narrative
event
Processing
interpretation

Keywords

  • comics
  • narrative
  • visual language
  • prediction
  • event cognition
  • Language
  • semantics
  • Linguistics

Cite this

@article{dd07cb6214de4574a8d7149bebe0d179,
title = "Prediction, events, and the advantage of agents: the processing of semantic roles in visual narrative",
abstract = "Agents consistently appear prior to Patients in sentences, manual signs, and drawings, and Agents are responded to faster when presented in visual depictions of events. We hypothesized that this {"}Agent advantage{"} reflects Agents' role in event structure. We investigated this question by manipulating the depictions of Agents and Patients in preparatory actions in wordless visual narratives. We found that Agents elicited a greater degree of predictions regarding upcoming events than Patients, that Agents are viewed longer than Patients, independent of serial order, and that visual depictions of actions are processed more quickly following the presentation of an Agent vs. a Patient. Taken together these findings support the notion that Agents initiate the building of event representation. We suggest that Agent First orders facilitate the interpretation of events as they unfold and that the saliency of Agents within visual representations of events is driven by anticipation of upcoming events.",
keywords = "comics, narrative, visual language, prediction, event cognition, Language, semantics, Linguistics",
author = "Neil Cohn and Martin Paczynski",
note = "Copyright {\circledC} 2013 Elsevier Inc. All rights reserved.",
year = "2013",
month = "11",
doi = "10.1016/j.cogpsych.2013.07.002",
language = "English",
volume = "67",
pages = "73--97",
journal = "Cognitive Psychology",
issn = "0010-0285",
publisher = "ACADEMIC PRESS INC ELSEVIER SCIENCE",
number = "3",

}

Prediction, events, and the advantage of agents : the processing of semantic roles in visual narrative. / Cohn, Neil; Paczynski, Martin.

In: Cognitive Psychology, Vol. 67, No. 3, 11.2013, p. 73-97.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Prediction, events, and the advantage of agents

T2 - the processing of semantic roles in visual narrative

AU - Cohn, Neil

AU - Paczynski, Martin

N1 - Copyright © 2013 Elsevier Inc. All rights reserved.

PY - 2013/11

Y1 - 2013/11

N2 - Agents consistently appear prior to Patients in sentences, manual signs, and drawings, and Agents are responded to faster when presented in visual depictions of events. We hypothesized that this "Agent advantage" reflects Agents' role in event structure. We investigated this question by manipulating the depictions of Agents and Patients in preparatory actions in wordless visual narratives. We found that Agents elicited a greater degree of predictions regarding upcoming events than Patients, that Agents are viewed longer than Patients, independent of serial order, and that visual depictions of actions are processed more quickly following the presentation of an Agent vs. a Patient. Taken together these findings support the notion that Agents initiate the building of event representation. We suggest that Agent First orders facilitate the interpretation of events as they unfold and that the saliency of Agents within visual representations of events is driven by anticipation of upcoming events.

AB - Agents consistently appear prior to Patients in sentences, manual signs, and drawings, and Agents are responded to faster when presented in visual depictions of events. We hypothesized that this "Agent advantage" reflects Agents' role in event structure. We investigated this question by manipulating the depictions of Agents and Patients in preparatory actions in wordless visual narratives. We found that Agents elicited a greater degree of predictions regarding upcoming events than Patients, that Agents are viewed longer than Patients, independent of serial order, and that visual depictions of actions are processed more quickly following the presentation of an Agent vs. a Patient. Taken together these findings support the notion that Agents initiate the building of event representation. We suggest that Agent First orders facilitate the interpretation of events as they unfold and that the saliency of Agents within visual representations of events is driven by anticipation of upcoming events.

KW - comics

KW - narrative

KW - visual language

KW - prediction

KW - event cognition

KW - Language

KW - semantics

KW - Linguistics

U2 - 10.1016/j.cogpsych.2013.07.002

DO - 10.1016/j.cogpsych.2013.07.002

M3 - Article

VL - 67

SP - 73

EP - 97

JO - Cognitive Psychology

JF - Cognitive Psychology

SN - 0010-0285

IS - 3

ER -