Trust by Interface: How Different User Interfaces Shape Human Trust in Health Information from Large Language Models

Xin Sun, Yunjie Liu, Jan De Wit, Jos A. Bosch, Zhuying Li

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

1 Downloads (Pure)

Abstract

The integration of Large Language Models (LLMs) with Conversational User Interfaces (CUIs) has significantly transformed health information seeking, offering interactive access to health resources. Despite the importance of trust in adopting health advice, the impact of user interfaces on trust perception in LLM-provided information remains unclear. Our mixed-methods study investigated how different CUIs (text-based, speech-based, and embodied) influence trust when using an identical LLM source. Key findings include (a) higher trust levels in information delivered via text-based interface compared to others; (b) a significant correlation between trust in the interface and the information provided; (c) participant’s prior experience, processing approach for information with different modalities and presentation styles, and usability level were key determinants of trust in health-related information. Our study sheds light on trust perceptions in health information from LLMs and its dissemination, underscoring the importance of user interface in trustworthy and effective health information seeking with LLM-powered CUIs.
Original languageUndefined/Unknown
Title of host publicationCHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
Place of PublicationNew York
PublisherACM
Number of pages7
ISBN (Print) 979-8-4007-0331-7
DOIs
Publication statusPublished - 11 May 2024
EventCHI '24: CHI Conference on Human Factors in Computing Systems - Honolulu, United States
Duration: 11 May 202416 May 2024

Conference

ConferenceCHI '24: CHI Conference on Human Factors in Computing Systems
Abbreviated titleCHI $A '24
Country/TerritoryUnited States
CityHonolulu
Period11/05/2416/05/24

Keywords

  • conversational user interface
  • large language models
  • healthcare
  • human trust perception

Cite this