Recalibration of vocal affect by a dynamic face

Research output: Contribution to journalArticleScientificpeer-review

3 Citations (Scopus)
68 Downloads (Pure)

Abstract

Perception of vocal affect is influenced by the concurrent sight of an emotional face. We demonstrate that the sight of an emotional face also can induce recalibration of vocal affect. Participants were exposed to videos of a 'happy' or 'fearful' face in combination with a slightly incongruous sentence with ambiguous prosody. After this exposure, ambiguous test sentences were rated as more 'happy' when the exposure phase contained 'happy' instead of 'fearful' faces. This auditory shift likely reflects recalibration that is induced by error minimization of the inter-sensory discrepancy. In line with this view, when the prosody of the exposure sentence was non-ambiguous and congruent with the face (without audiovisual discrepancy), aftereffects went in the opposite direction, likely reflecting adaptation. Our results demonstrate, for the first time, that perception of vocal affect is flexible and can be recalibrated by slightly discrepant visual information.

Original languageEnglish
Pages (from-to)1911–1918
JournalExperimental Brain Research
Volume236
Issue number7
DOIs
Publication statusPublished - 2018

Keywords

  • Adaptation
  • Audiovisual integration
  • BRAIN MECHANISMS
  • Cross-modal learning
  • DETECTORS
  • EMOTIONAL VOCALIZATIONS
  • EXPRESSION
  • Emotion perception
  • IDENTIFICATION
  • INTEGRATION
  • RECOGNITION
  • REPRESENTATION
  • SELECTIVE ADAPTATION
  • SPEECH-PERCEPTION

Fingerprint Dive into the research topics of 'Recalibration of vocal affect by a dynamic face'. Together they form a unique fingerprint.

  • Cite this