Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures

L. Mol, Milou Althof

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Abstract

One study found that observers retained more information from hand gestures that speakers gazed at, possibly because speaker-gaze shifted observers' attention covertly. Speaker-gaze may thus modulate the role of gestures in communication. One hypothesized communicative function of gestures, and specifically of the inter-personal repetition of gestures, is to facilitate the process of creating common ground (grounding). Therefore, speaker-gaze may also influence the inter-personal repetition of gestures. In an experimental study, we found that participants were more likely to repeat another speaker's gestures if the original speaker gazed at the gestures. Moreover, speaker-gaze was a better predictor of this repetition than participants' own gaze. This supports the hypothesis that speakers' gaze at their gestures leads to covert attention shifts in observers, causing the gestures to be processed differently. Speaker-gaze could therefore be a valuable cue to the processing and production of gestures by artificial systems that interact with humans.
Original languageEnglish
Title of host publicationProceedings of the 36th Annual Conference of the Cognitive Science Society
EditorsP. Bello, M. Guarini, M. McShane, B. Scassellati
PublisherAustin, TX: Cognitive Science Society
Pages2645-2650
Number of pages6
Publication statusPublished - 2014
EventCogSci 2014 - Québec City, Canada
Duration: 23 Jul 201426 Jul 2014

Conference

ConferenceCogSci 2014
CountryCanada
CityQuébec City
Period23/07/1426/07/14

Fingerprint

Gestures
Cues
Communication

Keywords

  • Gesture
  • Gaze
  • Perception
  • Alignment
  • Adaptation

Cite this

Mol, L., & Althof, M. (2014). Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36th Annual Conference of the Cognitive Science Society (pp. 2645-2650). Austin, TX: Cognitive Science Society.
Mol, L. ; Althof, Milou. / Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures. Proceedings of the 36th Annual Conference of the Cognitive Science Society. editor / P. Bello ; M. Guarini ; M. McShane ; B. Scassellati. Austin, TX: Cognitive Science Society, 2014. pp. 2645-2650
@inproceedings{d44eff7e4b2040f888aab58d9bb83304,
title = "Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures",
abstract = "One study found that observers retained more information from hand gestures that speakers gazed at, possibly because speaker-gaze shifted observers' attention covertly. Speaker-gaze may thus modulate the role of gestures in communication. One hypothesized communicative function of gestures, and specifically of the inter-personal repetition of gestures, is to facilitate the process of creating common ground (grounding). Therefore, speaker-gaze may also influence the inter-personal repetition of gestures. In an experimental study, we found that participants were more likely to repeat another speaker's gestures if the original speaker gazed at the gestures. Moreover, speaker-gaze was a better predictor of this repetition than participants' own gaze. This supports the hypothesis that speakers' gaze at their gestures leads to covert attention shifts in observers, causing the gestures to be processed differently. Speaker-gaze could therefore be a valuable cue to the processing and production of gestures by artificial systems that interact with humans.",
keywords = "Gesture, Gaze, Perception, Alignment, Adaptation",
author = "L. Mol and Milou Althof",
year = "2014",
language = "English",
pages = "2645--2650",
editor = "P. Bello and Guarini, {M. } and M. McShane and B. Scassellati",
booktitle = "Proceedings of the 36th Annual Conference of the Cognitive Science Society",
publisher = "Austin, TX: Cognitive Science Society",

}

Mol, L & Althof, M 2014, Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures. in P Bello, M Guarini, M McShane & B Scassellati (eds), Proceedings of the 36th Annual Conference of the Cognitive Science Society. Austin, TX: Cognitive Science Society, pp. 2645-2650, CogSci 2014, Québec City, Canada, 23/07/14.

Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures. / Mol, L.; Althof, Milou.

Proceedings of the 36th Annual Conference of the Cognitive Science Society. ed. / P. Bello; M. Guarini; M. McShane; B. Scassellati. Austin, TX: Cognitive Science Society, 2014. p. 2645-2650.

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

TY - GEN

T1 - Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures

AU - Mol, L.

AU - Althof, Milou

PY - 2014

Y1 - 2014

N2 - One study found that observers retained more information from hand gestures that speakers gazed at, possibly because speaker-gaze shifted observers' attention covertly. Speaker-gaze may thus modulate the role of gestures in communication. One hypothesized communicative function of gestures, and specifically of the inter-personal repetition of gestures, is to facilitate the process of creating common ground (grounding). Therefore, speaker-gaze may also influence the inter-personal repetition of gestures. In an experimental study, we found that participants were more likely to repeat another speaker's gestures if the original speaker gazed at the gestures. Moreover, speaker-gaze was a better predictor of this repetition than participants' own gaze. This supports the hypothesis that speakers' gaze at their gestures leads to covert attention shifts in observers, causing the gestures to be processed differently. Speaker-gaze could therefore be a valuable cue to the processing and production of gestures by artificial systems that interact with humans.

AB - One study found that observers retained more information from hand gestures that speakers gazed at, possibly because speaker-gaze shifted observers' attention covertly. Speaker-gaze may thus modulate the role of gestures in communication. One hypothesized communicative function of gestures, and specifically of the inter-personal repetition of gestures, is to facilitate the process of creating common ground (grounding). Therefore, speaker-gaze may also influence the inter-personal repetition of gestures. In an experimental study, we found that participants were more likely to repeat another speaker's gestures if the original speaker gazed at the gestures. Moreover, speaker-gaze was a better predictor of this repetition than participants' own gaze. This supports the hypothesis that speakers' gaze at their gestures leads to covert attention shifts in observers, causing the gestures to be processed differently. Speaker-gaze could therefore be a valuable cue to the processing and production of gestures by artificial systems that interact with humans.

KW - Gesture

KW - Gaze

KW - Perception

KW - Alignment

KW - Adaptation

M3 - Conference contribution

SP - 2645

EP - 2650

BT - Proceedings of the 36th Annual Conference of the Cognitive Science Society

A2 - Bello, P.

A2 - Guarini, M.

A2 - McShane, M.

A2 - Scassellati, B.

PB - Austin, TX: Cognitive Science Society

ER -

Mol L, Althof M. Speaker-gaze Modulates the Inter-personal Repetition of Hand Gestures. In Bello P, Guarini M, McShane M, Scassellati B, editors, Proceedings of the 36th Annual Conference of the Cognitive Science Society. Austin, TX: Cognitive Science Society. 2014. p. 2645-2650