Voice Your Opinion!: Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA)

C. Liebrecht; Naomi Kamoen; Celine Aerts

doi:10.1007/978-3-031-25581-6_3

Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA)

C. Liebrecht, Naomi Kamoen, Celine Aerts

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

1 Citation (Scopus)

Abstract

Conversational Agent Voting Advice Applications (CAVAAs) are chatbot-based information retrieval systems for citizens who aim to inform themselves about the political issues at stake in times of political elections. Previous studies investigating these relatively young tools primarily focused on the effects of CAVAAs that include a text-based chatbot. In order to further optimize their design, current research compared the effects of CAVAAs with a text, voice, and combined chatbot. In an experimental lab study among young voters (N = 60) these three modalities have been compared on usage measures (the amount of information retrieved from the chatbot, and miscommunication), evaluation measures (ease of use, usefulness, and enjoyment), and political measures (perceived and factual political knowledge). Results show that the three CAVAA modalities score equally high on political measures and the perception of enjoyment. At the same time, the textual and combined CAVAA outperform the voice CAVAA on several aspects: the voice CAVAA received lower ease of use and usefulness scores, respondents requested less additional information, and they experienced more miscommunication when interacting with the voice chatbot. Analyses of the usage data also indicate that in the combined condition users hardly use the voiceoption and instead almost exclusively rely on text-functionalities like clicking on suggestion buttons. This seems to suggest that using voice is too much of an effort for CAVAA users; we therefore recommend the usage of text-bots in this specific usage context.

Original language	English
Title of host publication	Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers
Editors	Asbjørn Følstad, Theo Araujo, Symeon Papadopoulos, Effie L.-C. Law, Ewa Luger, Morten Goodwin, Petter Bae Brandtzaeg
Publisher	Springer
Pages	34-49
Number of pages	16
ISBN (Electronic)	978-3-031-25581-6
ISBN (Print)	978-3-031-25580-9
DOIs	https://doi.org/10.1007/978-3-031-25581-6_3
Publication status	Published - 2 Feb 2023
Event	Conversations - University of Amsterdam, Amsterdam, Netherlands Duration: 22 Nov 2022 → 23 Nov 2022 https://2022.conversations.ws

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13815 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	Conversations
Country/Territory	Netherlands
City	Amsterdam
Period	22/11/22 → 23/11/22
Internet address	https://2022.conversations.ws

Keywords

chatbot
chatbot design
modality
voting advice applications
conversational agent
politics

Access to Document

10.1007/978-3-031-25581-6_3

Cite this

Liebrecht, C., Kamoen, N., & Aerts, C. (2023). Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA). In A. Følstad, T. Araujo, S. Papadopoulos, E. L.-C. Law, E. Luger, M. Goodwin, & P. B. Brandtzaeg (Eds.), Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers (pp. 34-49). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13815 LNCS). Springer. https://doi.org/10.1007/978-3-031-25581-6_3

Liebrecht, C. ; Kamoen, Naomi ; Aerts, Celine. / Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA). Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. editor / Asbjørn Følstad ; Theo Araujo ; Symeon Papadopoulos ; Effie L.-C. Law ; Ewa Luger ; Morten Goodwin ; Petter Bae Brandtzaeg. Springer, 2023. pp. 34-49 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{0652fae2fafe4edb904dc142036739ab,

title = "Voice Your Opinion!: Young Voters{\textquoteright} Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA)",

abstract = "Conversational Agent Voting Advice Applications (CAVAAs) are chatbot-based information retrieval systems for citizens who aim to inform themselves about the political issues at stake in times of political elections. Previous studies investigating these relatively young tools primarily focused on the effects of CAVAAs that include a text-based chatbot. In order to further optimize their design, current research compared the effects of CAVAAs with a text, voice, and combined chatbot. In an experimental lab study among young voters (N = 60) these three modalities have been compared on usage measures (the amount of information retrieved from the chatbot, and miscommunication), evaluation measures (ease of use, usefulness, and enjoyment), and political measures (perceived and factual political knowledge). Results show that the three CAVAA modalities score equally high on political measures and the perception of enjoyment. At the same time, the textual and combined CAVAA outperform the voice CAVAA on several aspects: the voice CAVAA received lower ease of use and usefulness scores, respondents requested less additional information, and they experienced more miscommunication when interacting with the voice chatbot. Analyses of the usage data also indicate that in the combined condition users hardly use the voiceoption and instead almost exclusively rely on text-functionalities like clicking on suggestion buttons. This seems to suggest that using voice is too much of an effort for CAVAA users; we therefore recommend the usage of text-bots in this specific usage context.",

keywords = "chatbot, chatbot design, modality, voting advice applications, conversational agent, politics",

author = "C. Liebrecht and Naomi Kamoen and Celine Aerts",

note = "Funding Information: Acknowledgements. The authors would like to thank Tilburg University{\textquoteright}s Fund (project number ESF2021–2) for the financial support to develop the CAVAAs. A summary of the results of this study has also been published in the Dutch popular-scientific magazine Tekstblad [22]. Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; Conversations ; Conference date: 22-11-2022 Through 23-11-2022",

year = "2023",

month = feb,

day = "2",

doi = "10.1007/978-3-031-25581-6_3",

language = "English",

isbn = "978-3-031-25580-9",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "34--49",

editor = "Asbj{\o}rn F{\o}lstad and Theo Araujo and Symeon Papadopoulos and Law, {Effie L.-C.} and Ewa Luger and Morten Goodwin and Brandtzaeg, {Petter Bae}",

booktitle = "Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers",

address = "Germany",

url = "https://2022.conversations.ws",

}

Liebrecht, C , Kamoen, N & Aerts, C 2023, Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA). in A Følstad, T Araujo, S Papadopoulos, EL-C Law, E Luger, M Goodwin & PB Brandtzaeg (eds), Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13815 LNCS, Springer, pp. 34-49, Conversations, Amsterdam, Netherlands, 22/11/22. https://doi.org/10.1007/978-3-031-25581-6_3

Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA). / Liebrecht, C.; Kamoen, Naomi; Aerts, Celine.
Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. ed. / Asbjørn Følstad; Theo Araujo; Symeon Papadopoulos; Effie L.-C. Law; Ewa Luger; Morten Goodwin; Petter Bae Brandtzaeg. Springer, 2023. p. 34-49 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 13815 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - Voice Your Opinion!

T2 - Conversations

AU - Liebrecht, C.

AU - Kamoen, Naomi

AU - Aerts, Celine

N1 - Funding Information: Acknowledgements. The authors would like to thank Tilburg University’s Fund (project number ESF2021–2) for the financial support to develop the CAVAAs. A summary of the results of this study has also been published in the Dutch popular-scientific magazine Tekstblad [22]. Publisher Copyright: © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

PY - 2023/2/2

Y1 - 2023/2/2

N2 - Conversational Agent Voting Advice Applications (CAVAAs) are chatbot-based information retrieval systems for citizens who aim to inform themselves about the political issues at stake in times of political elections. Previous studies investigating these relatively young tools primarily focused on the effects of CAVAAs that include a text-based chatbot. In order to further optimize their design, current research compared the effects of CAVAAs with a text, voice, and combined chatbot. In an experimental lab study among young voters (N = 60) these three modalities have been compared on usage measures (the amount of information retrieved from the chatbot, and miscommunication), evaluation measures (ease of use, usefulness, and enjoyment), and political measures (perceived and factual political knowledge). Results show that the three CAVAA modalities score equally high on political measures and the perception of enjoyment. At the same time, the textual and combined CAVAA outperform the voice CAVAA on several aspects: the voice CAVAA received lower ease of use and usefulness scores, respondents requested less additional information, and they experienced more miscommunication when interacting with the voice chatbot. Analyses of the usage data also indicate that in the combined condition users hardly use the voiceoption and instead almost exclusively rely on text-functionalities like clicking on suggestion buttons. This seems to suggest that using voice is too much of an effort for CAVAA users; we therefore recommend the usage of text-bots in this specific usage context.

AB - Conversational Agent Voting Advice Applications (CAVAAs) are chatbot-based information retrieval systems for citizens who aim to inform themselves about the political issues at stake in times of political elections. Previous studies investigating these relatively young tools primarily focused on the effects of CAVAAs that include a text-based chatbot. In order to further optimize their design, current research compared the effects of CAVAAs with a text, voice, and combined chatbot. In an experimental lab study among young voters (N = 60) these three modalities have been compared on usage measures (the amount of information retrieved from the chatbot, and miscommunication), evaluation measures (ease of use, usefulness, and enjoyment), and political measures (perceived and factual political knowledge). Results show that the three CAVAA modalities score equally high on political measures and the perception of enjoyment. At the same time, the textual and combined CAVAA outperform the voice CAVAA on several aspects: the voice CAVAA received lower ease of use and usefulness scores, respondents requested less additional information, and they experienced more miscommunication when interacting with the voice chatbot. Analyses of the usage data also indicate that in the combined condition users hardly use the voiceoption and instead almost exclusively rely on text-functionalities like clicking on suggestion buttons. This seems to suggest that using voice is too much of an effort for CAVAA users; we therefore recommend the usage of text-bots in this specific usage context.

KW - chatbot

KW - chatbot design

KW - modality

KW - voting advice applications

KW - conversational agent

KW - politics

UR - http://www.scopus.com/inward/record.url?scp=85148684206&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-25581-6_3

DO - 10.1007/978-3-031-25581-6_3

M3 - Conference contribution

SN - 978-3-031-25580-9

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 34

EP - 49

BT - Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers

A2 - Følstad, Asbjørn

A2 - Araujo, Theo

A2 - Papadopoulos, Symeon

A2 - Law, Effie L.-C.

A2 - Luger, Ewa

A2 - Goodwin, Morten

A2 - Brandtzaeg, Petter Bae

PB - Springer

Y2 - 22 November 2022 through 23 November 2022

ER -

Liebrecht C , Kamoen N, Aerts C. Voice Your Opinion! Young Voters’ Usage and Perceptions of a Text-Based, Voice-Based and Text-Voice Combined Conversational Agent Voting Advice Application (CAVAA). In Følstad A, Araujo T, Papadopoulos S, Law ELC, Luger E, Goodwin M, Brandtzaeg PB, editors, Chatbot Research and Design - 6th International Workshop, CONVERSATIONS 2022, Revised Selected Papers. Springer. 2023. p. 34-49. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-25581-6_3