Multimodal communication in face-to-face conversations

Max M. Louwerse; N. Benesh; M. E. Hoque; P. Jeuniaux; G. Lewis; J. Wu; M. Zirnstein

Multimodal communication in face-to-face conversations

Max M. Louwerse
, N. Benesh
, M. E. Hoque
, P. Jeuniaux
, G. Lewis
, J. Wu
, M. Zirnstein

Research output: Chapter in Book/Report/Conference proceeding › Chapter › Scientific › peer-review

Abstract

Multimodal communication involves multiple communicative channels including speech, facial movement, and gesture. Relatively few studies on how various communicative modalities are aligned in natural, face-to-face communication
exist. As part of a larger project, the current study investigates how discourse structure, speech features, eye gaze, and facial movements interrelate during a map coordination task. The study thereby sheds light on multimodal communication in humans and gives guidelines for the development of
embodied conversational agents.

Original language	English
Title of host publication	Proceedings of the 28th Annual Cognitive Science Society
Editors	D.S. McNamara, J.G. Trafton
Place of Publication	Austin, TX
Publisher	Cognitive Science Society
Pages	1235-1240
Number of pages	5
Publication status	Published - 2006
Externally published	Yes
Event	28th Annual Conference of the Cognitive Science Society - Sheraton Vancouver Wall Centre, Vancouver, Canada Duration: 26 Jul 2006 → 29 Jul 2006 Conference number: 28

Conference

Conference	28th Annual Conference of the Cognitive Science Society
Abbreviated title	CogSci 2006
Country/Territory	Canada
City	Vancouver
Period	26/07/06 → 29/07/06

Access to Document

http://csjarchive.cogsci.rpi.edu/proceedings/2007/docs/p1235.pdf

Cite this

@inbook{0698fb81f7de42fc9e73ded76e35d07c,

title = "Multimodal communication in face-to-face conversations",

abstract = "Multimodal communication involves multiple communicative channels including speech, facial movement, and gesture. Relatively few studies on how various communicative modalities are aligned in natural, face-to-face communication exist. As part of a larger project, the current study investigates how discourse structure, speech features, eye gaze, and facial movements interrelate during a map coordination task. The study thereby sheds light on multimodal communication in humans and gives guidelines for the development of embodied conversational agents. ",

author = "Louwerse, \{Max M.\} and N. Benesh and Hoque, \{M. E.\} and P. Jeuniaux and G. Lewis and J. Wu and M. Zirnstein",

year = "2006",

language = "English",

pages = "1235--1240",

editor = "D.S. McNamara and J.G. Trafton",

booktitle = "Proceedings of the 28th Annual Cognitive Science Society",

publisher = "Cognitive Science Society",

note = "28th Annual Conference of the Cognitive Science Society, CogSci 2006 ; Conference date: 26-07-2006 Through 29-07-2006",

}

Louwerse, MM, Benesh, N, Hoque, ME, Jeuniaux, P, Lewis, G, Wu, J & Zirnstein, M 2006, Multimodal communication in face-to-face conversations. in DS McNamara & JG Trafton (eds), Proceedings of the 28th Annual Cognitive Science Society. Cognitive Science Society, Austin, TX, pp. 1235-1240, 28th Annual Conference of the Cognitive Science Society, Vancouver, Canada, 26/07/06. <http://csjarchive.cogsci.rpi.edu/proceedings/2007/docs/p1235.pdf>

TY - CHAP

T1 - Multimodal communication in face-to-face conversations

AU - Louwerse, Max M.

AU - Benesh, N.

AU - Hoque, M. E.

AU - Jeuniaux, P.

AU - Lewis, G.

AU - Wu, J.

AU - Zirnstein, M.

N1 - Conference code: 28

PY - 2006

Y1 - 2006

N2 - Multimodal communication involves multiple communicative channels including speech, facial movement, and gesture. Relatively few studies on how various communicative modalities are aligned in natural, face-to-face communication exist. As part of a larger project, the current study investigates how discourse structure, speech features, eye gaze, and facial movements interrelate during a map coordination task. The study thereby sheds light on multimodal communication in humans and gives guidelines for the development of embodied conversational agents.

AB - Multimodal communication involves multiple communicative channels including speech, facial movement, and gesture. Relatively few studies on how various communicative modalities are aligned in natural, face-to-face communication exist. As part of a larger project, the current study investigates how discourse structure, speech features, eye gaze, and facial movements interrelate during a map coordination task. The study thereby sheds light on multimodal communication in humans and gives guidelines for the development of embodied conversational agents.

M3 - Chapter

SP - 1235

EP - 1240

BT - Proceedings of the 28th Annual Cognitive Science Society

A2 - McNamara, D.S.

A2 - Trafton, J.G.

PB - Cognitive Science Society

CY - Austin, TX

T2 - 28th Annual Conference of the Cognitive Science Society

Y2 - 26 July 2006 through 29 July 2006

ER -

Multimodal communication in face-to-face conversations

Abstract

Conference

Access to Document

Fingerprint

Cite this