TY - JOUR
T1 - Fluidity in the perception of auditory speech
T2 - Cross-modal recalibration of voice gender and vowel identity by a talking face
AU - Burgering, Merel
AU - van Laarhoven, Thijs
AU - Baart, Martijn
AU - Vroomen, Jean
N1 - Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by Gravitation Grant 024.001.006 of the Language in Interaction Consortium from Netherlands Organization for Scientific Research. The third author was supported by The Netherlands Organization for Scientific Research (NWO: VENI Grant 275-89-027).
PY - 2020
Y1 - 2020
N2 - Humans quickly adapt to variations in the speech signal. Adaptation may surface as recalibration, a learning effect driven by error-minimisation between a visual face and an ambiguous auditory speech signal, or as selective adaptation, a contrastive aftereffect driven by the acoustic clarity of the sound. Here, we examined whether these aftereffects occur for vowel identity and voice gender. Participants were exposed to male, female, or androgynous tokens of speakers pronouncing /e/, /ø/, (embedded in words with a consonant-vowel-consonant structure), or an ambiguous vowel halfway between /e/ and /ø/ dubbed onto the video of a male or female speaker pronouncing /e/ or /ø/. For both voice gender and vowel identity, we found assimilative aftereffects after exposure to auditory ambiguous adapter sounds, and contrastive aftereffects after exposure to auditory clear adapter sounds. This demonstrates that similar principles for adaptation in these dimensions are at play.
AB - Humans quickly adapt to variations in the speech signal. Adaptation may surface as recalibration, a learning effect driven by error-minimisation between a visual face and an ambiguous auditory speech signal, or as selective adaptation, a contrastive aftereffect driven by the acoustic clarity of the sound. Here, we examined whether these aftereffects occur for vowel identity and voice gender. Participants were exposed to male, female, or androgynous tokens of speakers pronouncing /e/, /ø/, (embedded in words with a consonant-vowel-consonant structure), or an ambiguous vowel halfway between /e/ and /ø/ dubbed onto the video of a male or female speaker pronouncing /e/ or /ø/. For both voice gender and vowel identity, we found assimilative aftereffects after exposure to auditory ambiguous adapter sounds, and contrastive aftereffects after exposure to auditory clear adapter sounds. This demonstrates that similar principles for adaptation in these dimensions are at play.
KW - Audiovisual integration
KW - EAR
KW - ELECTROPHYSIOLOGICAL EVIDENCE
KW - IDENTIFICATION
KW - INFORMATION
KW - LIPREAD SPEECH
KW - PHONETIC RECALIBRATION
KW - RECOGNITION
KW - SELECTIVE ADAPTATION
KW - SEX-DIFFERENCES
KW - SPEAKER
KW - gender
KW - recalibration
KW - selective adaptation
KW - vowel
U2 - 10.1177/1747021819900884
DO - 10.1177/1747021819900884
M3 - Article
SN - 1747-0218
VL - 73
SP - 957
EP - 967
JO - The Quarterly Journal of Experimental Psychology
JF - The Quarterly Journal of Experimental Psychology
IS - 6
ER -