Automatic detection of confusion in elderly users of a web-based health instruction video

    Research output: Contribution to journalArticleScientificpeer-review

    13 Citations (Scopus)

    Abstract

    BACKGROUND: Because of cognitive limitations and lower health literacy, many elderly patients have difficulty understanding verbal medical instructions. Automatic detection of facial movements provides a nonintrusive basis for building technological tools supporting confusion detection in healthcare delivery applications on the Internet.

    MATERIALS AND METHODS: Twenty-four elderly participants (70-90 years old) were recorded while watching Web-based health instruction videos involving easy and complex medical terminology. Relevant fragments of the participants' facial expressions were rated by 40 medical students for perceived level of confusion and analyzed with automatic software for facial movement recognition.

    RESULTS: A computer classification of the automatically detected facial features performed more accurately and with a higher sensitivity than the human observers (automatic detection and classification, 64% accuracy, 0.64 sensitivity; human observers, 41% accuracy, 0.43 sensitivity). A drill-down analysis of cues to confusion indicated the importance of the eye and eyebrow region.

    CONCLUSIONS: Confusion caused by misunderstanding of medical terminology is signaled by facial cues that can be automatically detected with currently available facial expression detection technology. The findings are relevant for the development of Web-based services for healthcare consumers.

    Original languageEnglish
    Pages (from-to)514-519
    Number of pages6
    JournalTelemedicine and e-Health
    Volume21
    Issue number6
    DOIs
    Publication statusPublished - Jun 2015

    Fingerprint

    Dive into the research topics of 'Automatic detection of confusion in elderly users of a web-based health instruction video'. Together they form a unique fingerprint.

    Cite this