Trustworthiness assessment in multimodal human-robot interaction based on cognitive load

Murat Kirtay, Erhan Oztop, Anna K. Kuhlen, Minoru Asada, Verena V. Hafner

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

6 Citations (Scopus)

Abstract

In this study, we extend our robot trust model into a multimodal setting in which the Nao robot leverages audio-visual data to perform a sequential multimodal pattern recalling task while interacting with a human partner who has different guiding strategies: reliable, unreliable, and random. Here, the humanoid robot is equipped with a multimodal auto-associative memory module to process audio-visual patterns to extract cognitive load (i.e., computational cost) and an internal reward module to perform cost-guided reinforcement learning. After interactive experiments, the robot associates a low cognitive load (i.e., high cumulative reward) yielded during the interaction with high trustworthiness of the guiding strategy of the partner. At the end of the experiment, we provide a free choice to the robot to select a trustworthy instructor. We show that the robot forms trust in a reliable partner. In the second setting of the same experiment, we endow the robot with an additional simple theory of mind module to assess the efficacy of the instructor in helping the robot perform the task. Our results show that the performance of the robot is improved when the robot bases its action decisions on factoring in the instructor assessment.

Original languageEnglish
Title of host publicationRO-MAN 2022 - 31st IEEE International Conference on Robot and Human Interactive Communication
Subtitle of host publicationSocial, Asocial, and Antisocial Robots
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages469-476
Number of pages8
ISBN (Electronic)9781728188591
DOIs
Publication statusPublished - 2022
Event31st IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2022 - Napoli, Italy
Duration: 29 Aug 20222 Sept 2022

Publication series

NameRO-MAN 2022 - 31st IEEE International Conference on Robot and Human Interactive Communication: Social, Asocial, and Antisocial Robots

Conference

Conference31st IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2022
Country/TerritoryItaly
CityNapoli
Period29/08/222/09/22

Fingerprint

Dive into the research topics of 'Trustworthiness assessment in multimodal human-robot interaction based on cognitive load'. Together they form a unique fingerprint.

Cite this