Recalibration of vocal affect by a dynamic face

Research output: Contribution to journalArticleScientificpeer-review

21 Downloads (Pure)

Abstract

Perception of vocal affect is influenced by the concurrent sight of an emotional face. We demonstrate that the sight of an emotional face also can induce recalibration of vocal affect. Participants were exposed to videos of a 'happy' or 'fearful' face in combination with a slightly incongruous sentence with ambiguous prosody. After this exposure, ambiguous test sentences were rated as more 'happy' when the exposure phase contained 'happy' instead of 'fearful' faces. This auditory shift likely reflects recalibration that is induced by error minimization of the inter-sensory discrepancy. In line with this view, when the prosody of the exposure sentence was non-ambiguous and congruent with the face (without audiovisual discrepancy), aftereffects went in the opposite direction, likely reflecting adaptation. Our results demonstrate, for the first time, that perception of vocal affect is flexible and can be recalibrated by slightly discrepant visual information.

Original languageEnglish
Pages (from-to)1911–1918
JournalExperimental Brain Research
Volume236
Issue number7
DOIs
Publication statusPublished - 2018

Keywords

  • Adaptation
  • Audiovisual integration
  • BRAIN MECHANISMS
  • Cross-modal learning
  • DETECTORS
  • EMOTIONAL VOCALIZATIONS
  • EXPRESSION
  • Emotion perception
  • IDENTIFICATION
  • INTEGRATION
  • RECOGNITION
  • REPRESENTATION
  • SELECTIVE ADAPTATION
  • SPEECH-PERCEPTION

Cite this

@article{b8e50824de774ab7b1c599323931a45f,
title = "Recalibration of vocal affect by a dynamic face",
abstract = "Perception of vocal affect is influenced by the concurrent sight of an emotional face. We demonstrate that the sight of an emotional face also can induce recalibration of vocal affect. Participants were exposed to videos of a 'happy' or 'fearful' face in combination with a slightly incongruous sentence with ambiguous prosody. After this exposure, ambiguous test sentences were rated as more 'happy' when the exposure phase contained 'happy' instead of 'fearful' faces. This auditory shift likely reflects recalibration that is induced by error minimization of the inter-sensory discrepancy. In line with this view, when the prosody of the exposure sentence was non-ambiguous and congruent with the face (without audiovisual discrepancy), aftereffects went in the opposite direction, likely reflecting adaptation. Our results demonstrate, for the first time, that perception of vocal affect is flexible and can be recalibrated by slightly discrepant visual information.",
keywords = "Adaptation, Audiovisual integration, BRAIN MECHANISMS, Cross-modal learning, DETECTORS, EMOTIONAL VOCALIZATIONS, EXPRESSION, Emotion perception, IDENTIFICATION, INTEGRATION, RECOGNITION, REPRESENTATION, SELECTIVE ADAPTATION, SPEECH-PERCEPTION",
author = "M. Baart and J.. Vroomen",
year = "2018",
doi = "10.1007/s00221-018-5270-y",
language = "English",
volume = "236",
pages = "1911–1918",
journal = "Experimental Brain Research",
issn = "0014-4819",
publisher = "Springer",
number = "7",

}

Recalibration of vocal affect by a dynamic face. / Baart, M.; Vroomen, J..

In: Experimental Brain Research, Vol. 236, No. 7, 2018, p. 1911–1918.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Recalibration of vocal affect by a dynamic face

AU - Baart, M.

AU - Vroomen, J..

PY - 2018

Y1 - 2018

N2 - Perception of vocal affect is influenced by the concurrent sight of an emotional face. We demonstrate that the sight of an emotional face also can induce recalibration of vocal affect. Participants were exposed to videos of a 'happy' or 'fearful' face in combination with a slightly incongruous sentence with ambiguous prosody. After this exposure, ambiguous test sentences were rated as more 'happy' when the exposure phase contained 'happy' instead of 'fearful' faces. This auditory shift likely reflects recalibration that is induced by error minimization of the inter-sensory discrepancy. In line with this view, when the prosody of the exposure sentence was non-ambiguous and congruent with the face (without audiovisual discrepancy), aftereffects went in the opposite direction, likely reflecting adaptation. Our results demonstrate, for the first time, that perception of vocal affect is flexible and can be recalibrated by slightly discrepant visual information.

AB - Perception of vocal affect is influenced by the concurrent sight of an emotional face. We demonstrate that the sight of an emotional face also can induce recalibration of vocal affect. Participants were exposed to videos of a 'happy' or 'fearful' face in combination with a slightly incongruous sentence with ambiguous prosody. After this exposure, ambiguous test sentences were rated as more 'happy' when the exposure phase contained 'happy' instead of 'fearful' faces. This auditory shift likely reflects recalibration that is induced by error minimization of the inter-sensory discrepancy. In line with this view, when the prosody of the exposure sentence was non-ambiguous and congruent with the face (without audiovisual discrepancy), aftereffects went in the opposite direction, likely reflecting adaptation. Our results demonstrate, for the first time, that perception of vocal affect is flexible and can be recalibrated by slightly discrepant visual information.

KW - Adaptation

KW - Audiovisual integration

KW - BRAIN MECHANISMS

KW - Cross-modal learning

KW - DETECTORS

KW - EMOTIONAL VOCALIZATIONS

KW - EXPRESSION

KW - Emotion perception

KW - IDENTIFICATION

KW - INTEGRATION

KW - RECOGNITION

KW - REPRESENTATION

KW - SELECTIVE ADAPTATION

KW - SPEECH-PERCEPTION

U2 - 10.1007/s00221-018-5270-y

DO - 10.1007/s00221-018-5270-y

M3 - Article

VL - 236

SP - 1911

EP - 1918

JO - Experimental Brain Research

JF - Experimental Brain Research

SN - 0014-4819

IS - 7

ER -