Assessment of incongruent emotions in face and voice

S. Takagi, K.-I. Tabei, E.M.J. Huis in 't Veld, B. de Gelder, A. Tanaka

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Information derived from facial and vocal nonverbal expressions plays an important role in social communication in the real and virtual worlds. In the present study, we investigated cultural differences between Japanese and Dutch participants in the multisensory perception of emotion. We used a face and voice that expressed incongruent emotions as stimuli and conducted two experiments. We presented either the face or voice in Experiment 1, and both the face and voice in Experiment 2. We found that both visual and auditory information were important for Japanese participants judging in-group stimuli, while visual information was more important for other combinations of participants and stimuli. Additionally, we showed that the in-group advantage provided by auditory information was higher in Japanese than Dutch participants. Our findings indicate that audio-visual integration of affective information is modulated by the perceiver's cultural backgroun
Original languageEnglish
Pages (from-to)29-39
JournalJapanese Journal of Psychonomic Science
Volume32
Issue number1
DOIs
Publication statusPublished - 2013

Fingerprint

Expressed Emotion
Communication

Cite this

@article{0e751d2628e84b738596439c43838199,
title = "Assessment of incongruent emotions in face and voice",
abstract = "Information derived from facial and vocal nonverbal expressions plays an important role in social communication in the real and virtual worlds. In the present study, we investigated cultural differences between Japanese and Dutch participants in the multisensory perception of emotion. We used a face and voice that expressed incongruent emotions as stimuli and conducted two experiments. We presented either the face or voice in Experiment 1, and both the face and voice in Experiment 2. We found that both visual and auditory information were important for Japanese participants judging in-group stimuli, while visual information was more important for other combinations of participants and stimuli. Additionally, we showed that the in-group advantage provided by auditory information was higher in Japanese than Dutch participants. Our findings indicate that audio-visual integration of affective information is modulated by the perceiver's cultural backgroun",
author = "S. Takagi and K.-I. Tabei and {Huis in 't Veld}, E.M.J. and {de Gelder}, B. and A. Tanaka",
year = "2013",
doi = "10.14947/psychono.KJ00008988953",
language = "English",
volume = "32",
pages = "29--39",
journal = "Japanese Journal of Psychonomic Science",
issn = "0287-7651",
number = "1",

}

Assessment of incongruent emotions in face and voice. / Takagi, S.; Tabei, K.-I.; Huis in 't Veld, E.M.J.; de Gelder, B.; Tanaka, A.

In: Japanese Journal of Psychonomic Science, Vol. 32, No. 1, 2013, p. 29-39.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Assessment of incongruent emotions in face and voice

AU - Takagi, S.

AU - Tabei, K.-I.

AU - Huis in 't Veld, E.M.J.

AU - de Gelder, B.

AU - Tanaka, A.

PY - 2013

Y1 - 2013

N2 - Information derived from facial and vocal nonverbal expressions plays an important role in social communication in the real and virtual worlds. In the present study, we investigated cultural differences between Japanese and Dutch participants in the multisensory perception of emotion. We used a face and voice that expressed incongruent emotions as stimuli and conducted two experiments. We presented either the face or voice in Experiment 1, and both the face and voice in Experiment 2. We found that both visual and auditory information were important for Japanese participants judging in-group stimuli, while visual information was more important for other combinations of participants and stimuli. Additionally, we showed that the in-group advantage provided by auditory information was higher in Japanese than Dutch participants. Our findings indicate that audio-visual integration of affective information is modulated by the perceiver's cultural backgroun

AB - Information derived from facial and vocal nonverbal expressions plays an important role in social communication in the real and virtual worlds. In the present study, we investigated cultural differences between Japanese and Dutch participants in the multisensory perception of emotion. We used a face and voice that expressed incongruent emotions as stimuli and conducted two experiments. We presented either the face or voice in Experiment 1, and both the face and voice in Experiment 2. We found that both visual and auditory information were important for Japanese participants judging in-group stimuli, while visual information was more important for other combinations of participants and stimuli. Additionally, we showed that the in-group advantage provided by auditory information was higher in Japanese than Dutch participants. Our findings indicate that audio-visual integration of affective information is modulated by the perceiver's cultural backgroun

U2 - 10.14947/psychono.KJ00008988953

DO - 10.14947/psychono.KJ00008988953

M3 - Article

VL - 32

SP - 29

EP - 39

JO - Japanese Journal of Psychonomic Science

JF - Japanese Journal of Psychonomic Science

SN - 0287-7651

IS - 1

ER -