Audiovisual perception of communication problems

P. Barkhuysen; E.J. Krahmer; M.G.J. Swerts

Audiovisual perception of communication problems

P. Barkhuysen, E.J. Krahmer, M.G.J. Swerts

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

71 Downloads (Pure)

Abstract

We describe three perception studies in which subjects are offered film fragments (without any dialogue context) of speakers interacting with a spoken dialogue system. In half of these fragments, the speaker is or becomes aware of a communication problem. Subjects have to determine by forced choice which are the problematic fragments. In all three studies, subjects are capable of performing this task to some extent, but with varying levels of correct classifications. We conclude that combining auditory with visual information is beneficial for problem detection.

Original language	English
Title of host publication	Proceedings of the Second International Conference on Speech Prosody
Editors	B. Bell, I. Marien
Place of Publication	Nara (Japan)
Publisher	SProSIG
Pages	271-274
Number of pages	4
ISBN (Print)	2951823312
Publication status	Published - 2004

Access to Document

Audiovisual

http://foap.uvt.nl/

Information presentation in multimodal interfaces
Krahmer, E. (Researcher)
1/01/04 → 31/12/09
Project: Research project
Functions of audiovisual prosody
Swerts, M. (Principal Investigator)
1/01/03 → 1/03/08
Project: Research project

Cite this

@inproceedings{1e0e0bd0ed994c39a2789aef37eab1f5,

title = "Audiovisual perception of communication problems",

abstract = "We describe three perception studies in which subjects are offered film fragments (without any dialogue context) of speakers interacting with a spoken dialogue system. In half of these fragments, the speaker is or becomes aware of a communication problem. Subjects have to determine by forced choice which are the problematic fragments. In all three studies, subjects are capable of performing this task to some extent, but with varying levels of correct classifications. We conclude that combining auditory with visual information is beneficial for problem detection.",

author = "P. Barkhuysen and E.J. Krahmer and M.G.J. Swerts",

note = "Pagination: 4",

year = "2004",

language = "English",

isbn = "2951823312",

pages = "271--274",

editor = "B. Bell and I. Marien",

booktitle = "Proceedings of the Second International Conference on Speech Prosody",

publisher = "SProSIG",

}

TY - GEN

T1 - Audiovisual perception of communication problems

AU - Barkhuysen, P.

AU - Krahmer, E.J.

AU - Swerts, M.G.J.

N1 - Pagination: 4

PY - 2004

Y1 - 2004

N2 - We describe three perception studies in which subjects are offered film fragments (without any dialogue context) of speakers interacting with a spoken dialogue system. In half of these fragments, the speaker is or becomes aware of a communication problem. Subjects have to determine by forced choice which are the problematic fragments. In all three studies, subjects are capable of performing this task to some extent, but with varying levels of correct classifications. We conclude that combining auditory with visual information is beneficial for problem detection.

AB - We describe three perception studies in which subjects are offered film fragments (without any dialogue context) of speakers interacting with a spoken dialogue system. In half of these fragments, the speaker is or becomes aware of a communication problem. Subjects have to determine by forced choice which are the problematic fragments. In all three studies, subjects are capable of performing this task to some extent, but with varying levels of correct classifications. We conclude that combining auditory with visual information is beneficial for problem detection.

M3 - Conference contribution

SN - 2951823312

SP - 271

EP - 274

BT - Proceedings of the Second International Conference on Speech Prosody

A2 - Bell, B.

A2 - Marien, I.

PB - SProSIG

CY - Nara (Japan)

ER -

Audiovisual perception of communication problems

Abstract

Access to Document

Fingerprint

Projects

Information presentation in multimodal interfaces

Functions of audiovisual prosody

Cite this