Beat gestures influence which speech sounds you hear

Hans Rutger Bosker*, David Peeters

*Corresponding author for this work

    Research output: Contribution to journalArticleScientificpeer-review

    Abstract

    Beat gestures-spontaneously produced biphasic movements of the hand-are among the most frequently encountered co-speech gestures in human communication. They are closely temporally aligned to the prosodic characteristics of the speech signal, typically occurring on lexically stressed syllables. Despite their prevalence across speakers of the world's languages, how beat gestures impact spoken word recognition is unclear. Can these simple 'flicks of the hand' influence speech perception? Across a range of experiments, we demonstrate that beat gestures influence the explicit and implicit perception of lexical stress (e.g. distinguishing OBject from obJECT), and in turn can influence what vowels listeners hear. Thus, we provide converging evidence for a manual McGurk effect: relatively simple and widely occurring hand movements influence which speech sounds we hear.

    Original languageEnglish
    Article number20202419
    Number of pages9
    JournalProceedings of the Royal Society B-Biological Sciences
    Volume288
    Issue number1943
    DOIs
    Publication statusPublished - 27 Jan 2021

    Keywords

    • audiovisual speech perception
    • manual McGurk effect
    • multimodal communication
    • beat gestures
    • lexical stress
    • AUDITORY-CORTEX
    • PERCEPTION
    • LANGUAGE
    • INFORMATION
    • INTEGRATION
    • CUES
    • PREDICTION
    • TRACKING
    • MODEL
    • TIME

    Fingerprint

    Dive into the research topics of 'Beat gestures influence which speech sounds you hear'. Together they form a unique fingerprint.

    Cite this