Infants’ preference for native audiovisual speech dissociated from congruency preference

Kathleen Shaw, Martijn Baart, Nicole Depowski, Heather Bortfeld*

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Although infant speech perception in often studied in isolated modalities, infants' experience with speech is largely multimodal (i.e., speech sounds they hear are accompanied by articulating faces). Across two experiments, we tested infants' sensitivity to the relationship between the auditory and visual components of audiovisual speech in their native (English) and non-native (Spanish) language. In Experiment 1, infants' looking times were measured during a preferential looking task in which they saw two simultaneous visual speech streams articulating a story, one in English and the other in Spanish, while they heard either the English or the Spanish version of the story. In Experiment 2, looking times from another group of infants were measured as they watched single displays of congruent and incongruent combinations of English and Spanish audio and visual speech streams. Findings demonstrated an age-related increase in looking towards the native relative to non-native visual speech stream when accompanied by the corresponding (native) auditory speech. This increase in native language preference did not appear to be driven by a difference in preference for native vs. non-native audiovisual congruence as we observed no difference in looking times at the audiovisual streams in Experiment 2.
Original languageEnglish
Pages (from-to)e0126059
JournalPLoS ONE
Volume10
DOIs
Publication statusPublished - 2015
Externally publishedYes

Fingerprint

Language
Phonetics
Experiments
Display devices
Acoustic waves

Cite this

Shaw, Kathleen ; Baart, Martijn ; Depowski, Nicole ; Bortfeld, Heather. / Infants’ preference for native audiovisual speech dissociated from congruency preference. In: PLoS ONE. 2015 ; Vol. 10. pp. e0126059.
@article{77aa8577ff8e4b91be1e18db0f2dc6d2,
title = "Infants’ preference for native audiovisual speech dissociated from congruency preference",
abstract = "Although infant speech perception in often studied in isolated modalities, infants' experience with speech is largely multimodal (i.e., speech sounds they hear are accompanied by articulating faces). Across two experiments, we tested infants' sensitivity to the relationship between the auditory and visual components of audiovisual speech in their native (English) and non-native (Spanish) language. In Experiment 1, infants' looking times were measured during a preferential looking task in which they saw two simultaneous visual speech streams articulating a story, one in English and the other in Spanish, while they heard either the English or the Spanish version of the story. In Experiment 2, looking times from another group of infants were measured as they watched single displays of congruent and incongruent combinations of English and Spanish audio and visual speech streams. Findings demonstrated an age-related increase in looking towards the native relative to non-native visual speech stream when accompanied by the corresponding (native) auditory speech. This increase in native language preference did not appear to be driven by a difference in preference for native vs. non-native audiovisual congruence as we observed no difference in looking times at the audiovisual streams in Experiment 2.",
author = "Kathleen Shaw and Martijn Baart and Nicole Depowski and Heather Bortfeld",
year = "2015",
doi = "10.1371/journal.pone.0126059",
language = "English",
volume = "10",
pages = "e0126059",
journal = "PLoS ONE",
issn = "1932-6203",
publisher = "PUBLIC LIBRARY SCIENCE",

}

Infants’ preference for native audiovisual speech dissociated from congruency preference. / Shaw, Kathleen; Baart, Martijn; Depowski, Nicole; Bortfeld, Heather.

In: PLoS ONE, Vol. 10, 2015, p. e0126059.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Infants’ preference for native audiovisual speech dissociated from congruency preference

AU - Shaw, Kathleen

AU - Baart, Martijn

AU - Depowski, Nicole

AU - Bortfeld, Heather

PY - 2015

Y1 - 2015

N2 - Although infant speech perception in often studied in isolated modalities, infants' experience with speech is largely multimodal (i.e., speech sounds they hear are accompanied by articulating faces). Across two experiments, we tested infants' sensitivity to the relationship between the auditory and visual components of audiovisual speech in their native (English) and non-native (Spanish) language. In Experiment 1, infants' looking times were measured during a preferential looking task in which they saw two simultaneous visual speech streams articulating a story, one in English and the other in Spanish, while they heard either the English or the Spanish version of the story. In Experiment 2, looking times from another group of infants were measured as they watched single displays of congruent and incongruent combinations of English and Spanish audio and visual speech streams. Findings demonstrated an age-related increase in looking towards the native relative to non-native visual speech stream when accompanied by the corresponding (native) auditory speech. This increase in native language preference did not appear to be driven by a difference in preference for native vs. non-native audiovisual congruence as we observed no difference in looking times at the audiovisual streams in Experiment 2.

AB - Although infant speech perception in often studied in isolated modalities, infants' experience with speech is largely multimodal (i.e., speech sounds they hear are accompanied by articulating faces). Across two experiments, we tested infants' sensitivity to the relationship between the auditory and visual components of audiovisual speech in their native (English) and non-native (Spanish) language. In Experiment 1, infants' looking times were measured during a preferential looking task in which they saw two simultaneous visual speech streams articulating a story, one in English and the other in Spanish, while they heard either the English or the Spanish version of the story. In Experiment 2, looking times from another group of infants were measured as they watched single displays of congruent and incongruent combinations of English and Spanish audio and visual speech streams. Findings demonstrated an age-related increase in looking towards the native relative to non-native visual speech stream when accompanied by the corresponding (native) auditory speech. This increase in native language preference did not appear to be driven by a difference in preference for native vs. non-native audiovisual congruence as we observed no difference in looking times at the audiovisual streams in Experiment 2.

U2 - 10.1371/journal.pone.0126059

DO - 10.1371/journal.pone.0126059

M3 - Article

VL - 10

SP - e0126059

JO - PLoS ONE

JF - PLoS ONE

SN - 1932-6203

ER -