Temporal and identity prediction in visual-auditory events: Electrophysiological evidence from stimulus omissions

Research output: Contribution to conferencePosterOther research output

5 Downloads (Pure)

Abstract

A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruent
audiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1(Experiment 2).
Original languageEnglish
Publication statusPublished - 20 May 2017
Event18th International Multisensory Research Forum (IMRF). - Nashville, United States
Duration: 19 May 201722 May 2017

Conference

Conference18th International Multisensory Research Forum (IMRF).
CountryUnited States
CityNashville
Period19/05/1722/05/17

Fingerprint

Omission
Stimulus
Prediction
Sound
Hearing
Experiment
Onset
Visual Stimuli
Auditory Stimuli
Electroencephalogram
Car

Cite this

van Laarhoven, T. J. T. M., Stekelenburg, J. J., & Vroomen, J. (2017). Temporal and identity prediction in visual-auditory events: Electrophysiological evidence from stimulus omissions. Poster session presented at 18th International Multisensory Research Forum (IMRF)., Nashville, United States.
@conference{5ee19e38d83c4767accd9061a9a8769c,
title = "Temporal and identity prediction in visual-auditory events: Electrophysiological evidence from stimulus omissions",
abstract = "A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruentaudiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1(Experiment 2).",
author = "{van Laarhoven}, T.J.T.M. and J.J. Stekelenburg and J. Vroomen",
year = "2017",
month = "5",
day = "20",
language = "English",
note = "18th International Multisensory Research Forum (IMRF). ; Conference date: 19-05-2017 Through 22-05-2017",

}

van Laarhoven, TJTM, Stekelenburg, JJ & Vroomen, J 2017, 'Temporal and identity prediction in visual-auditory events: Electrophysiological evidence from stimulus omissions' 18th International Multisensory Research Forum (IMRF)., Nashville, United States, 19/05/17 - 22/05/17, .

Temporal and identity prediction in visual-auditory events : Electrophysiological evidence from stimulus omissions. / van Laarhoven, T.J.T.M.; Stekelenburg, J.J.; Vroomen, J.

2017. Poster session presented at 18th International Multisensory Research Forum (IMRF)., Nashville, United States.

Research output: Contribution to conferencePosterOther research output

TY - CONF

T1 - Temporal and identity prediction in visual-auditory events

T2 - Electrophysiological evidence from stimulus omissions

AU - van Laarhoven, T.J.T.M.

AU - Stekelenburg, J.J.

AU - Vroomen, J.

PY - 2017/5/20

Y1 - 2017/5/20

N2 - A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruentaudiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1(Experiment 2).

AB - A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruentaudiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1(Experiment 2).

M3 - Poster

ER -

van Laarhoven TJTM, Stekelenburg JJ, Vroomen J. Temporal and identity prediction in visual-auditory events: Electrophysiological evidence from stimulus omissions. 2017. Poster session presented at 18th International Multisensory Research Forum (IMRF)., Nashville, United States.