Temporal and identity prediction in visual-auditory events

Electrophysiological evidence from stimulus omissions

Research output: Contribution to journalArticleScientificpeer-review

149 Downloads (Pure)

Abstract

A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruent audiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1 (Experiment 2).
Original languageEnglish
Pages (from-to)79-87
JournalBrain Research
Volume1661
DOIs
Publication statusPublished - 15 Apr 2017

Fingerprint

Electroencephalography

Keywords

  • Stimulus omission
  • Predictive coding
  • Event-related potentials
  • Visual-auditory

Cite this

@article{7f258d0e4e55427f8a0b2b352edbfbd3,
title = "Temporal and identity prediction in visual-auditory events: Electrophysiological evidence from stimulus omissions",
abstract = "A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruent audiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1 (Experiment 2).",
keywords = "Stimulus omission, Predictive coding, Event-related potentials, Visual-auditory",
author = "{van Laarhoven}, T.J.T.M. and J.J. Stekelenburg and J. Vroomen",
year = "2017",
month = "4",
day = "15",
doi = "10.1016/j.brainres.2017.02.014",
language = "English",
volume = "1661",
pages = "79--87",
journal = "Brain Research",
issn = "0006-8993",
publisher = "Elsevier Science BV",

}

Temporal and identity prediction in visual-auditory events : Electrophysiological evidence from stimulus omissions. / van Laarhoven, T.J.T.M.; Stekelenburg, J.J.; Vroomen, J.

In: Brain Research, Vol. 1661, 15.04.2017, p. 79-87.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Temporal and identity prediction in visual-auditory events

T2 - Electrophysiological evidence from stimulus omissions

AU - van Laarhoven, T.J.T.M.

AU - Stekelenburg, J.J.

AU - Vroomen, J.

PY - 2017/4/15

Y1 - 2017/4/15

N2 - A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruent audiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1 (Experiment 2).

AB - A rare omission of a sound that is predictable by anticipatory visual information induces an early negative omission response (oN1) in the EEG during the period of silence where the sound was expected. It was previously suggested that the oN1 was primarily driven by the identity of the anticipated sound. Here, we examined the role of temporal prediction in conjunction with identity prediction of the anticipated sound in the evocation of the auditory oN1. With incongruent audiovisual stimuli (a video of a handclap that is consistently combined with the sound of a car horn) we demonstrate in Experiment 1 that a natural match in identity between the visual and auditory stimulus is not required for inducing the oN1, and that the perceptual system can adapt predictions to unnatural stimulus events. In Experiment 2 we varied either the auditory onset (relative to the visual onset) or the identity of the sound across trials in order to hamper temporal and identity predictions. Relative to the natural stimulus with correct auditory timing and matching audiovisual identity, the oN1 was abolished when either the timing or the identity of the sound could not be predicted reliably from the video. Our study demonstrates the flexibility of the perceptual system in predictive processing (Experiment 1) and also shows that precise predictions of timing and content are both essential elements for inducing an oN1 (Experiment 2).

KW - Stimulus omission

KW - Predictive coding

KW - Event-related potentials

KW - Visual-auditory

U2 - 10.1016/j.brainres.2017.02.014

DO - 10.1016/j.brainres.2017.02.014

M3 - Article

VL - 1661

SP - 79

EP - 87

JO - Brain Research

JF - Brain Research

SN - 0006-8993

ER -