A perceptual and behavioral analysis of facial cues to deception in interactions between children and a virtual agent

M. Vieira Da Fonseca Serras Pereira, Jolanda de Lange, Suleman Shahid, Marc Swerts

Research output: Contribution to journalArticleScientificpeer-review

Abstract

This study focused on the facial expressions that children exhibit while trying to deceive a virtual agent. An interactive lie elicitation game was developed to record children’s facial expressions during deceptive and truthful utterances. Our participants did this task either alone or in the presence of peers. A manual method and an automatic recognition approach were used to examine facial expressions and facial action units (AUs). Results show that the facial expressions of deceivers differ from those of truth-tellers: most clearly, they try to cover their lie as they smile significantly more often than truthful children. Moreover, co-presence enhances children’s facial expressive behavior and the number of deceptive cues. To understand whether such features serve as cues for deception detection, using data from children playing alone or together with another child, a perception test was carried out to examine observers’ ability to distinguish young deceivers from truth-tellers. Results show that observers found it easier to discriminate between deceivers and truth-tellers who had played the game in the co-present condition. Our research thus shows that virtual agents can be used as tools to elicit lies in a playful manner, which would be relevant for developmental, educational and behavioral analyses of deceit in growing children.
Original languageEnglish
Pages (from-to)1-12
Number of pages12
JournalInternational Journal of Child-Computer Interaction
Volume15
DOIs
Publication statusPublished - Mar 2018

Fingerprint

facial expression
interaction
present
ability

Keywords

  • Child–virtual agent interaction
  • Lying behavior
  • Nonverbal communication
  • Facial expressions
  • Children

Cite this

@article{a90f6d72f2b14a0abfcd5845fddc9214,
title = "A perceptual and behavioral analysis of facial cues to deception in interactions between children and a virtual agent",
abstract = "This study focused on the facial expressions that children exhibit while trying to deceive a virtual agent. An interactive lie elicitation game was developed to record children’s facial expressions during deceptive and truthful utterances. Our participants did this task either alone or in the presence of peers. A manual method and an automatic recognition approach were used to examine facial expressions and facial action units (AUs). Results show that the facial expressions of deceivers differ from those of truth-tellers: most clearly, they try to cover their lie as they smile significantly more often than truthful children. Moreover, co-presence enhances children’s facial expressive behavior and the number of deceptive cues. To understand whether such features serve as cues for deception detection, using data from children playing alone or together with another child, a perception test was carried out to examine observers’ ability to distinguish young deceivers from truth-tellers. Results show that observers found it easier to discriminate between deceivers and truth-tellers who had played the game in the co-present condition. Our research thus shows that virtual agents can be used as tools to elicit lies in a playful manner, which would be relevant for developmental, educational and behavioral analyses of deceit in growing children.",
keywords = "Child–virtual agent interaction, Lying behavior, Nonverbal communication, Facial expressions, Children",
author = "{Vieira Da Fonseca Serras Pereira}, M. and {de Lange}, Jolanda and Suleman Shahid and Marc Swerts",
year = "2018",
month = "3",
doi = "10.1016/j.ijcci.2017.10.003",
language = "English",
volume = "15",
pages = "1--12",
journal = "International Journal of Child-Computer Interaction",
issn = "2212-8689",
publisher = "Elsevier",

}

A perceptual and behavioral analysis of facial cues to deception in interactions between children and a virtual agent. / Vieira Da Fonseca Serras Pereira, M.; de Lange, Jolanda; Shahid, Suleman; Swerts, Marc.

In: International Journal of Child-Computer Interaction, Vol. 15, 03.2018, p. 1-12.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - A perceptual and behavioral analysis of facial cues to deception in interactions between children and a virtual agent

AU - Vieira Da Fonseca Serras Pereira, M.

AU - de Lange, Jolanda

AU - Shahid, Suleman

AU - Swerts, Marc

PY - 2018/3

Y1 - 2018/3

N2 - This study focused on the facial expressions that children exhibit while trying to deceive a virtual agent. An interactive lie elicitation game was developed to record children’s facial expressions during deceptive and truthful utterances. Our participants did this task either alone or in the presence of peers. A manual method and an automatic recognition approach were used to examine facial expressions and facial action units (AUs). Results show that the facial expressions of deceivers differ from those of truth-tellers: most clearly, they try to cover their lie as they smile significantly more often than truthful children. Moreover, co-presence enhances children’s facial expressive behavior and the number of deceptive cues. To understand whether such features serve as cues for deception detection, using data from children playing alone or together with another child, a perception test was carried out to examine observers’ ability to distinguish young deceivers from truth-tellers. Results show that observers found it easier to discriminate between deceivers and truth-tellers who had played the game in the co-present condition. Our research thus shows that virtual agents can be used as tools to elicit lies in a playful manner, which would be relevant for developmental, educational and behavioral analyses of deceit in growing children.

AB - This study focused on the facial expressions that children exhibit while trying to deceive a virtual agent. An interactive lie elicitation game was developed to record children’s facial expressions during deceptive and truthful utterances. Our participants did this task either alone or in the presence of peers. A manual method and an automatic recognition approach were used to examine facial expressions and facial action units (AUs). Results show that the facial expressions of deceivers differ from those of truth-tellers: most clearly, they try to cover their lie as they smile significantly more often than truthful children. Moreover, co-presence enhances children’s facial expressive behavior and the number of deceptive cues. To understand whether such features serve as cues for deception detection, using data from children playing alone or together with another child, a perception test was carried out to examine observers’ ability to distinguish young deceivers from truth-tellers. Results show that observers found it easier to discriminate between deceivers and truth-tellers who had played the game in the co-present condition. Our research thus shows that virtual agents can be used as tools to elicit lies in a playful manner, which would be relevant for developmental, educational and behavioral analyses of deceit in growing children.

KW - Child–virtual agent interaction

KW - Lying behavior

KW - Nonverbal communication

KW - Facial expressions

KW - Children

U2 - 10.1016/j.ijcci.2017.10.003

DO - 10.1016/j.ijcci.2017.10.003

M3 - Article

VL - 15

SP - 1

EP - 12

JO - International Journal of Child-Computer Interaction

JF - International Journal of Child-Computer Interaction

SN - 2212-8689

ER -