Abstract
It is crucial that naturally-looking Embodied Conversational Agents (ECAs) display various verbal and non-verbal behaviors, including facial expressions. The generation of credible facial expressions has been approached by means of different methods, yet remains difficult because of the availability of naturalistic data. To infuse more variability into the facial expressions of ECAs, we proposed a model that considered temporal dynamic of facial behaviors as a countable-state Markov process. Once trained, the model was able to output new sequences of facial expressions from an existing dataset containing facial videos with Action Unit (AU) encodings. The approach was validated by having computer software and humans identify facial emotion from video. Half of the videos employed newly generated sequences of facial expressions using the model while the other half contained sequences selected directly from the original dataset. We found no statistically significant evidence that the newly generated facial expression sequences could be differentiated from the original ones, demonstrating that the model was able to generate new facial expression data that were indistinguishable from the original data. Our proposed approach could be used to expand the amount of labelled facial expression data in order to create new training sets for machine learning methods.
Original language | English |
---|---|
Title of host publication | IVA 2019 - Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents |
Publisher | Association for Computing Machinery |
Pages | 94-96 |
Number of pages | 3 |
ISBN (Print) | 9781450366724 |
DOIs | |
Publication status | Published - 1 Jul 2019 |
Event | ACM International Virtual Agents 2019 - Paris, France Duration: 2 Jul 2019 → 5 Jul 2019 https://iva2019.sciencesconf.org/ |
Publication series
Name | IVA 2019 - Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents |
---|
Conference
Conference | ACM International Virtual Agents 2019 |
---|---|
Abbreviated title | ACM IVA 2019 |
Country/Territory | France |
City | Paris |
Period | 2/07/19 → 5/07/19 |
Internet address |
Keywords
- Embodied Conversational Agents
- Facial Action Coding System (FACS)
- Facial expressions
- Machine Learning
- Non-Verbal communication