Production and Comprehension of Pantomimes Used to Depict Objects

Karin van Nispen, Mieke van de Sandt-Koenderman, Emiel Krahmer

Research output: Contribution to journalArticleScientificpeer-review

19 Downloads (Pure)

Abstract

Pantomime, gesture in absence of speech, has no conventional meaning. Nevertheless, individuals seem to be able to produce pantomimes and derive meaning from pantomimes. A number of studies has addressed the use of co-speech gesture, but little is known on pantomime. Therefore, the question of how people construct and understand pantomimes arises in gesture research. To determine how people use pantomimes, we asked participants to depict a set of objects using pantomimes only. We annotated what representation techniques people produced. Furthermore, using judgment tasks, we assessed the pantomimes’ comprehensibility. Analyses showed that similar techniques were used to depict objects across individuals. Objects with a default depiction method were better comprehended than objects for which there was no such default. More specifically, tools and objects depicted using a handling technique were better understood. The open-answer experiment showed low interpretation accuracy. Conversely, the forced-choice experiment showed ceiling effects. These results suggest that across individuals, similar strategies are deployed to produce pantomime, with the handling technique as the apparent preference. This might indicate that the production of pantomimes is based on mental representations which are intrinsically similar. Furthermore, pantomime conveys semantically rich, but ambiguous, information, and is much dependent on context. This pantomime database will be made available online. This can be used as a baseline with which we can compare clinical groups.
Original languageEnglish
Pages (from-to)Online publication
JournalFrontiers in Psychology
Volume8
DOIs
Publication statusPublished - 2017

Fingerprint

Gestures
Databases

Keywords

  • pantomie
  • idiosyncracy
  • iconicity
  • individual variation
  • non-verbal communication
  • Gesture

Cite this

van Nispen, Karin ; van de Sandt-Koenderman, Mieke ; Krahmer, Emiel. / Production and Comprehension of Pantomimes Used to Depict Objects. In: Frontiers in Psychology. 2017 ; Vol. 8. pp. Online publication.
@article{37529c022b26421cb56d05ee85ddcb8e,
title = "Production and Comprehension of Pantomimes Used to Depict Objects",
abstract = "Pantomime, gesture in absence of speech, has no conventional meaning. Nevertheless, individuals seem to be able to produce pantomimes and derive meaning from pantomimes. A number of studies has addressed the use of co-speech gesture, but little is known on pantomime. Therefore, the question of how people construct and understand pantomimes arises in gesture research. To determine how people use pantomimes, we asked participants to depict a set of objects using pantomimes only. We annotated what representation techniques people produced. Furthermore, using judgment tasks, we assessed the pantomimes’ comprehensibility. Analyses showed that similar techniques were used to depict objects across individuals. Objects with a default depiction method were better comprehended than objects for which there was no such default. More specifically, tools and objects depicted using a handling technique were better understood. The open-answer experiment showed low interpretation accuracy. Conversely, the forced-choice experiment showed ceiling effects. These results suggest that across individuals, similar strategies are deployed to produce pantomime, with the handling technique as the apparent preference. This might indicate that the production of pantomimes is based on mental representations which are intrinsically similar. Furthermore, pantomime conveys semantically rich, but ambiguous, information, and is much dependent on context. This pantomime database will be made available online. This can be used as a baseline with which we can compare clinical groups.",
keywords = "pantomie, idiosyncracy, iconicity, individual variation, non-verbal communication, Gesture",
author = "{van Nispen}, Karin and {van de Sandt-Koenderman}, Mieke and Emiel Krahmer",
year = "2017",
doi = "10.3389/fpsyg.2017.01095",
language = "English",
volume = "8",
pages = "Online publication",
journal = "Frontiers in Psychology",
issn = "1664-1078",
publisher = "Frontiers Media S.A.",

}

Production and Comprehension of Pantomimes Used to Depict Objects. / van Nispen, Karin; van de Sandt-Koenderman, Mieke; Krahmer, Emiel.

In: Frontiers in Psychology, Vol. 8, 2017, p. Online publication.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Production and Comprehension of Pantomimes Used to Depict Objects

AU - van Nispen, Karin

AU - van de Sandt-Koenderman, Mieke

AU - Krahmer, Emiel

PY - 2017

Y1 - 2017

N2 - Pantomime, gesture in absence of speech, has no conventional meaning. Nevertheless, individuals seem to be able to produce pantomimes and derive meaning from pantomimes. A number of studies has addressed the use of co-speech gesture, but little is known on pantomime. Therefore, the question of how people construct and understand pantomimes arises in gesture research. To determine how people use pantomimes, we asked participants to depict a set of objects using pantomimes only. We annotated what representation techniques people produced. Furthermore, using judgment tasks, we assessed the pantomimes’ comprehensibility. Analyses showed that similar techniques were used to depict objects across individuals. Objects with a default depiction method were better comprehended than objects for which there was no such default. More specifically, tools and objects depicted using a handling technique were better understood. The open-answer experiment showed low interpretation accuracy. Conversely, the forced-choice experiment showed ceiling effects. These results suggest that across individuals, similar strategies are deployed to produce pantomime, with the handling technique as the apparent preference. This might indicate that the production of pantomimes is based on mental representations which are intrinsically similar. Furthermore, pantomime conveys semantically rich, but ambiguous, information, and is much dependent on context. This pantomime database will be made available online. This can be used as a baseline with which we can compare clinical groups.

AB - Pantomime, gesture in absence of speech, has no conventional meaning. Nevertheless, individuals seem to be able to produce pantomimes and derive meaning from pantomimes. A number of studies has addressed the use of co-speech gesture, but little is known on pantomime. Therefore, the question of how people construct and understand pantomimes arises in gesture research. To determine how people use pantomimes, we asked participants to depict a set of objects using pantomimes only. We annotated what representation techniques people produced. Furthermore, using judgment tasks, we assessed the pantomimes’ comprehensibility. Analyses showed that similar techniques were used to depict objects across individuals. Objects with a default depiction method were better comprehended than objects for which there was no such default. More specifically, tools and objects depicted using a handling technique were better understood. The open-answer experiment showed low interpretation accuracy. Conversely, the forced-choice experiment showed ceiling effects. These results suggest that across individuals, similar strategies are deployed to produce pantomime, with the handling technique as the apparent preference. This might indicate that the production of pantomimes is based on mental representations which are intrinsically similar. Furthermore, pantomime conveys semantically rich, but ambiguous, information, and is much dependent on context. This pantomime database will be made available online. This can be used as a baseline with which we can compare clinical groups.

KW - pantomie

KW - idiosyncracy

KW - iconicity

KW - individual variation

KW - non-verbal communication

KW - Gesture

U2 - 10.3389/fpsyg.2017.01095

DO - 10.3389/fpsyg.2017.01095

M3 - Article

VL - 8

SP - Online publication

JO - Frontiers in Psychology

JF - Frontiers in Psychology

SN - 1664-1078

ER -