Intersensory binding across space and time: A tutorial review

L. Chen, J. Vroomen

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Spatial ventriloquism refers to the phenomenon that a visual stimulus such as a flash can attract the perceived location of a spatially discordant but temporally synchronous sound. An analogous example of mutual attraction between audition and vision has been found in the temporal domain, where temporal aspects of a visual event, such as its onset, frequency, or duration, can be biased by a slightly asynchronous sound. In this review, we examine various manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and we discuss important constraints on the occurrence of these effects. Factors that potentially modulate ventriloquism—such as attention, synesthetic correspondence, and other cognitive factors—are described. We trace theories and models of spatial and temporal ventriloquism, from the traditional unity assumption and modality appropriateness hypothesis to more recent Bayesian and neural network approaches. Finally, we summarize recent evidence probing the underlying neural mechanisms of spatial and temporal ventriloquism.
Keywords: Multisensory, Processing, Temporal processing, Spatial localization
Original languageEnglish
Pages (from-to)790-811
JournalAttention, Perception & Psychophysics
Volume75
Issue number5
DOIs
Publication statusPublished - 2013

Fingerprint

neural network
stimulus
event
evidence
Hearing
time
Ventriloquism
Attraction
Sound
Audition
Key Words
Onset
Visual Stimuli
Appropriateness
Localization
Trace Theory
Bayesian Networks
Modality
Unity
Manifestation

Cite this

@article{f052bbc66eb54a5fb0e3fe35e9522736,
title = "Intersensory binding across space and time: A tutorial review",
abstract = "Spatial ventriloquism refers to the phenomenon that a visual stimulus such as a flash can attract the perceived location of a spatially discordant but temporally synchronous sound. An analogous example of mutual attraction between audition and vision has been found in the temporal domain, where temporal aspects of a visual event, such as its onset, frequency, or duration, can be biased by a slightly asynchronous sound. In this review, we examine various manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and we discuss important constraints on the occurrence of these effects. Factors that potentially modulate ventriloquism—such as attention, synesthetic correspondence, and other cognitive factors—are described. We trace theories and models of spatial and temporal ventriloquism, from the traditional unity assumption and modality appropriateness hypothesis to more recent Bayesian and neural network approaches. Finally, we summarize recent evidence probing the underlying neural mechanisms of spatial and temporal ventriloquism.Keywords: Multisensory, Processing, Temporal processing, Spatial localization",
author = "L. Chen and J. Vroomen",
year = "2013",
doi = "10.3758/s13414-013-0475-4",
language = "English",
volume = "75",
pages = "790--811",
journal = "Attention, Perception & Psychophysics",
issn = "1943-3921",
publisher = "Springer",
number = "5",

}

Intersensory binding across space and time : A tutorial review. / Chen, L.; Vroomen, J.

In: Attention, Perception & Psychophysics, Vol. 75, No. 5, 2013, p. 790-811.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Intersensory binding across space and time

T2 - A tutorial review

AU - Chen, L.

AU - Vroomen, J.

PY - 2013

Y1 - 2013

N2 - Spatial ventriloquism refers to the phenomenon that a visual stimulus such as a flash can attract the perceived location of a spatially discordant but temporally synchronous sound. An analogous example of mutual attraction between audition and vision has been found in the temporal domain, where temporal aspects of a visual event, such as its onset, frequency, or duration, can be biased by a slightly asynchronous sound. In this review, we examine various manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and we discuss important constraints on the occurrence of these effects. Factors that potentially modulate ventriloquism—such as attention, synesthetic correspondence, and other cognitive factors—are described. We trace theories and models of spatial and temporal ventriloquism, from the traditional unity assumption and modality appropriateness hypothesis to more recent Bayesian and neural network approaches. Finally, we summarize recent evidence probing the underlying neural mechanisms of spatial and temporal ventriloquism.Keywords: Multisensory, Processing, Temporal processing, Spatial localization

AB - Spatial ventriloquism refers to the phenomenon that a visual stimulus such as a flash can attract the perceived location of a spatially discordant but temporally synchronous sound. An analogous example of mutual attraction between audition and vision has been found in the temporal domain, where temporal aspects of a visual event, such as its onset, frequency, or duration, can be biased by a slightly asynchronous sound. In this review, we examine various manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and we discuss important constraints on the occurrence of these effects. Factors that potentially modulate ventriloquism—such as attention, synesthetic correspondence, and other cognitive factors—are described. We trace theories and models of spatial and temporal ventriloquism, from the traditional unity assumption and modality appropriateness hypothesis to more recent Bayesian and neural network approaches. Finally, we summarize recent evidence probing the underlying neural mechanisms of spatial and temporal ventriloquism.Keywords: Multisensory, Processing, Temporal processing, Spatial localization

U2 - 10.3758/s13414-013-0475-4

DO - 10.3758/s13414-013-0475-4

M3 - Article

VL - 75

SP - 790

EP - 811

JO - Attention, Perception & Psychophysics

JF - Attention, Perception & Psychophysics

SN - 1943-3921

IS - 5

ER -