Audiovisual perception of communication problems

P. Barkhuysen, E.J. Krahmer, M.G.J. Swerts

    Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

    54 Downloads (Pure)


    We describe three perception studies in which subjects are offered film fragments (without any dialogue context) of speakers interacting with a spoken dialogue system. In half of these fragments, the speaker is or becomes aware of a communication problem. Subjects have to determine by forced choice which are the problematic fragments. In all three studies, subjects are capable of performing this task to some extent, but with varying levels of correct classifications. We conclude that combining auditory with visual information is beneficial for problem detection.
    Original languageEnglish
    Title of host publicationProceedings of the Second International Conference on Speech Prosody
    EditorsB. Bell, I. Marien
    Place of PublicationNara (Japan)
    Number of pages4
    ISBN (Print)2951823312
    Publication statusPublished - 2004

    Fingerprint Dive into the research topics of 'Audiovisual perception of communication problems'. Together they form a unique fingerprint.

  • Projects

    Information presentation in multimodal interfaces

    Krahmer, E.


    Project: Research project

    Functions of audiovisual prosody

    Swerts, M.


    Project: Research project

    Cite this

    Barkhuysen, P., Krahmer, E. J., & Swerts, M. G. J. (2004). Audiovisual perception of communication problems. In B. Bell, & I. Marien (Eds.), Proceedings of the Second International Conference on Speech Prosody (pp. 271-274). SProSIG.