Cross-modal noise compensation in audiovisual words

M. Baart, Blair C. Armstrong, Clara D. Martin, Ram Frost, Manuel Carreiras

Research output: Contribution to journalArticleScientificpeer-review

17 Downloads (Pure)

Abstract

Perceiving linguistic input is vital for human functioning, but the process is complicated by the fact that the incoming signal is often degraded. However, humans can compensate for unimodal noise by relying on simultaneous sensory input from another modality. Here, we investigated noise-compensation for spoken and printed words in two experiments. In the first behavioral experiment, we observed that accuracy was modulated by reaction time, bias and sensitivity, but noise compensation could nevertheless be explained via accuracy differences when controlling for RT, bias and sensitivity. In the second experiment, we also measured Event Related Potentials (ERPs) and observed robust electrophysiological correlates of noise compensation starting at around 350 ms after stimulus onset, indicating that noise compensation is most prominent at lexical/semantic processing levels.
Original languageEnglish
Article number42055
JournalScientific Reports
Volume7
DOIs
Publication statusPublished - 7 Feb 2017

Cite this

Baart, M., Armstrong, B. C., Martin, C. D., Frost, R., & Carreiras, M. (2017). Cross-modal noise compensation in audiovisual words. Scientific Reports, 7, [42055]. https://doi.org/10.1038/srep42055
Baart, M. ; Armstrong, Blair C. ; Martin, Clara D. ; Frost, Ram ; Carreiras, Manuel. / Cross-modal noise compensation in audiovisual words. In: Scientific Reports. 2017 ; Vol. 7.
@article{06618dded2584c039f0834b6f5f35f06,
title = "Cross-modal noise compensation in audiovisual words",
abstract = "Perceiving linguistic input is vital for human functioning, but the process is complicated by the fact that the incoming signal is often degraded. However, humans can compensate for unimodal noise by relying on simultaneous sensory input from another modality. Here, we investigated noise-compensation for spoken and printed words in two experiments. In the first behavioral experiment, we observed that accuracy was modulated by reaction time, bias and sensitivity, but noise compensation could nevertheless be explained via accuracy differences when controlling for RT, bias and sensitivity. In the second experiment, we also measured Event Related Potentials (ERPs) and observed robust electrophysiological correlates of noise compensation starting at around 350 ms after stimulus onset, indicating that noise compensation is most prominent at lexical/semantic processing levels.",
author = "M. Baart and Armstrong, {Blair C.} and Martin, {Clara D.} and Ram Frost and Manuel Carreiras",
year = "2017",
month = "2",
day = "7",
doi = "10.1038/srep42055",
language = "English",
volume = "7",
journal = "Scientific Reports",
issn = "2045-2322",
publisher = "Nature Publishing Group",

}

Baart, M, Armstrong, BC, Martin, CD, Frost, R & Carreiras, M 2017, 'Cross-modal noise compensation in audiovisual words', Scientific Reports, vol. 7, 42055. https://doi.org/10.1038/srep42055

Cross-modal noise compensation in audiovisual words. / Baart, M.; Armstrong, Blair C.; Martin, Clara D.; Frost, Ram; Carreiras, Manuel.

In: Scientific Reports, Vol. 7, 42055, 07.02.2017.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Cross-modal noise compensation in audiovisual words

AU - Baart, M.

AU - Armstrong, Blair C.

AU - Martin, Clara D.

AU - Frost, Ram

AU - Carreiras, Manuel

PY - 2017/2/7

Y1 - 2017/2/7

N2 - Perceiving linguistic input is vital for human functioning, but the process is complicated by the fact that the incoming signal is often degraded. However, humans can compensate for unimodal noise by relying on simultaneous sensory input from another modality. Here, we investigated noise-compensation for spoken and printed words in two experiments. In the first behavioral experiment, we observed that accuracy was modulated by reaction time, bias and sensitivity, but noise compensation could nevertheless be explained via accuracy differences when controlling for RT, bias and sensitivity. In the second experiment, we also measured Event Related Potentials (ERPs) and observed robust electrophysiological correlates of noise compensation starting at around 350 ms after stimulus onset, indicating that noise compensation is most prominent at lexical/semantic processing levels.

AB - Perceiving linguistic input is vital for human functioning, but the process is complicated by the fact that the incoming signal is often degraded. However, humans can compensate for unimodal noise by relying on simultaneous sensory input from another modality. Here, we investigated noise-compensation for spoken and printed words in two experiments. In the first behavioral experiment, we observed that accuracy was modulated by reaction time, bias and sensitivity, but noise compensation could nevertheless be explained via accuracy differences when controlling for RT, bias and sensitivity. In the second experiment, we also measured Event Related Potentials (ERPs) and observed robust electrophysiological correlates of noise compensation starting at around 350 ms after stimulus onset, indicating that noise compensation is most prominent at lexical/semantic processing levels.

U2 - 10.1038/srep42055

DO - 10.1038/srep42055

M3 - Article

VL - 7

JO - Scientific Reports

JF - Scientific Reports

SN - 2045-2322

M1 - 42055

ER -

Baart M, Armstrong BC, Martin CD, Frost R, Carreiras M. Cross-modal noise compensation in audiovisual words. Scientific Reports. 2017 Feb 7;7. 42055. https://doi.org/10.1038/srep42055