Rhythm in vocal emotional expressions

the normalized pairwise variability index differentiates emotions across languages

Martijn Goudbeek, M. Broersma

Research output: Contribution to conferenceAbstractOther research output

Abstract

The voice is an important channel for emotional expression. Emotions are of- ten characterized by differences in pitch, loudness, the duration of segments, and spectral characteristics (Scherer, 2003). The rhythmic aspect of emotional speech has been largely neglected, most studies limit themselves to segment duration and speech rate. Since languages are often characterized by their rhythmic class (as either “stress timed” or “syllable timed”), we wanted to know whether the rhythmic structure plays a role in vocal emotional expres- sions. To characterize the rhythmic structure, we used the normalized pairwise variability index. The normalized pairwise variability index (nPVI) characterizes the rhythm of a language in a more continuous way (Grabe & Low, 2002). Quin- to, Thompson, and Keating (2013) found that the nPVI differentiated emotio- nal expressions from non-emotional ones. However, their study was limited to English (a stress timed language) and their nonsensical carrier sentence contai- ned real words, possibly influencing the role of speech rhythm. This contribu- tion investigates whether the nPVI can be used to characterize the possible rhythmic differences between emotions in a stress timed and a syllable timed language (Dutch and Korean). We do so by using an existing corpus (Goudbeek & Broersma, 2010) of eight posed emotional expressions (balanced for valance and arousal) by speakers of Dutch and Korean. The findings show, as expected, that Dutch and Korean differ in their nPVI, but, importantly, that the different emotions in the corpus also differ in their nPVI. Further analysis shows that emotional valence is an important contributor to these differences. Finally, the effects are different for Dutch and Korean, indicating the importance of studying different languages when investigating vocal emotional expression.
Original languageEnglish
Pages1
Number of pages1
Publication statusPublished - 8 Jul 2015

Fingerprint

emotion
language

Keywords

  • Emotion
  • Language
  • Speech
  • Rhythm
  • Prosody
  • nPVI

Cite this

@conference{2b37ac85362643e3b0c57e6e6971e3c9,
title = "Rhythm in vocal emotional expressions: the normalized pairwise variability index differentiates emotions across languages",
abstract = "The voice is an important channel for emotional expression. Emotions are of- ten characterized by differences in pitch, loudness, the duration of segments, and spectral characteristics (Scherer, 2003). The rhythmic aspect of emotional speech has been largely neglected, most studies limit themselves to segment duration and speech rate. Since languages are often characterized by their rhythmic class (as either “stress timed” or “syllable timed”), we wanted to know whether the rhythmic structure plays a role in vocal emotional expres- sions. To characterize the rhythmic structure, we used the normalized pairwise variability index. The normalized pairwise variability index (nPVI) characterizes the rhythm of a language in a more continuous way (Grabe & Low, 2002). Quin- to, Thompson, and Keating (2013) found that the nPVI differentiated emotio- nal expressions from non-emotional ones. However, their study was limited to English (a stress timed language) and their nonsensical carrier sentence contai- ned real words, possibly influencing the role of speech rhythm. This contribu- tion investigates whether the nPVI can be used to characterize the possible rhythmic differences between emotions in a stress timed and a syllable timed language (Dutch and Korean). We do so by using an existing corpus (Goudbeek & Broersma, 2010) of eight posed emotional expressions (balanced for valance and arousal) by speakers of Dutch and Korean. The findings show, as expected, that Dutch and Korean differ in their nPVI, but, importantly, that the different emotions in the corpus also differ in their nPVI. Further analysis shows that emotional valence is an important contributor to these differences. Finally, the effects are different for Dutch and Korean, indicating the importance of studying different languages when investigating vocal emotional expression.",
keywords = "Emotion, Language, Speech, Rhythm, Prosody, nPVI",
author = "Martijn Goudbeek and M. Broersma",
year = "2015",
month = "7",
day = "8",
language = "English",
pages = "1",

}

Rhythm in vocal emotional expressions : the normalized pairwise variability index differentiates emotions across languages. / Goudbeek, Martijn; Broersma, M.

2015. 1.

Research output: Contribution to conferenceAbstractOther research output

TY - CONF

T1 - Rhythm in vocal emotional expressions

T2 - the normalized pairwise variability index differentiates emotions across languages

AU - Goudbeek, Martijn

AU - Broersma, M.

PY - 2015/7/8

Y1 - 2015/7/8

N2 - The voice is an important channel for emotional expression. Emotions are of- ten characterized by differences in pitch, loudness, the duration of segments, and spectral characteristics (Scherer, 2003). The rhythmic aspect of emotional speech has been largely neglected, most studies limit themselves to segment duration and speech rate. Since languages are often characterized by their rhythmic class (as either “stress timed” or “syllable timed”), we wanted to know whether the rhythmic structure plays a role in vocal emotional expres- sions. To characterize the rhythmic structure, we used the normalized pairwise variability index. The normalized pairwise variability index (nPVI) characterizes the rhythm of a language in a more continuous way (Grabe & Low, 2002). Quin- to, Thompson, and Keating (2013) found that the nPVI differentiated emotio- nal expressions from non-emotional ones. However, their study was limited to English (a stress timed language) and their nonsensical carrier sentence contai- ned real words, possibly influencing the role of speech rhythm. This contribu- tion investigates whether the nPVI can be used to characterize the possible rhythmic differences between emotions in a stress timed and a syllable timed language (Dutch and Korean). We do so by using an existing corpus (Goudbeek & Broersma, 2010) of eight posed emotional expressions (balanced for valance and arousal) by speakers of Dutch and Korean. The findings show, as expected, that Dutch and Korean differ in their nPVI, but, importantly, that the different emotions in the corpus also differ in their nPVI. Further analysis shows that emotional valence is an important contributor to these differences. Finally, the effects are different for Dutch and Korean, indicating the importance of studying different languages when investigating vocal emotional expression.

AB - The voice is an important channel for emotional expression. Emotions are of- ten characterized by differences in pitch, loudness, the duration of segments, and spectral characteristics (Scherer, 2003). The rhythmic aspect of emotional speech has been largely neglected, most studies limit themselves to segment duration and speech rate. Since languages are often characterized by their rhythmic class (as either “stress timed” or “syllable timed”), we wanted to know whether the rhythmic structure plays a role in vocal emotional expres- sions. To characterize the rhythmic structure, we used the normalized pairwise variability index. The normalized pairwise variability index (nPVI) characterizes the rhythm of a language in a more continuous way (Grabe & Low, 2002). Quin- to, Thompson, and Keating (2013) found that the nPVI differentiated emotio- nal expressions from non-emotional ones. However, their study was limited to English (a stress timed language) and their nonsensical carrier sentence contai- ned real words, possibly influencing the role of speech rhythm. This contribu- tion investigates whether the nPVI can be used to characterize the possible rhythmic differences between emotions in a stress timed and a syllable timed language (Dutch and Korean). We do so by using an existing corpus (Goudbeek & Broersma, 2010) of eight posed emotional expressions (balanced for valance and arousal) by speakers of Dutch and Korean. The findings show, as expected, that Dutch and Korean differ in their nPVI, but, importantly, that the different emotions in the corpus also differ in their nPVI. Further analysis shows that emotional valence is an important contributor to these differences. Finally, the effects are different for Dutch and Korean, indicating the importance of studying different languages when investigating vocal emotional expression.

KW - Emotion

KW - Language

KW - Speech

KW - Rhythm

KW - Prosody

KW - nPVI

M3 - Abstract

SP - 1

ER -