Positive vs. Negative: The Impact of Question Polarity in Voting Advice Applications

Bregje Holleman*, Naomi Kamoen, Andre Krouwel, Jasper van de Pol, Claes de Vreese

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Online Voting Advice Applications (VAAs) are survey-like instruments that help citizens to shape their political preferences and compare them with those of political parties. Especially in multi-party democracies, their increasing popularity indicates that VAAs play an important role in opinion formation for citizens, as well as in the public debate prior to elections. Hence, the objectivity and transparency of VAAs are crucial. In the design of VAAs, many choices have to be made. Extant research in survey methodology shows that the seemingly arbitrary choice to word questions positively (e.g., 'The city council should allow cars into the city centre') or negatively ('The city council should ban cars from the city centre') systematically affects the answers. This asymmetry in answers is in line with work on negativity bias in other areas of linguistics and psychology. Building on these findings, this study investigated whether question polarity also affects the answers to VAA statements. In a field experiment (N = 31,112) during the Dutch municipal elections we analysed the effects of polarity for 16 out of 30 VAA statements with a large variety of linguistic contrasts. Analyses show a significant effect of question wording for questions containing a wide range of implicit negations (such as 'forbid' vs. 'allow'), as well as for questions with explicit negations (e.g., 'not'). These effects of question polarity are found especially for VAA users with lower levels of political sophistication. As these citizens are an important target group for Voting Advice Applications, this stresses the need for VAA builders to be sensitive to wording choices when designing VAAs. This study is the first to show such consistent wording effects not only for political attitude questions with implicit negations in VAAs, but also for political questions containing explicit negations.

Original languageEnglish
Article number0164184
Number of pages17
JournalPLoS ONE
Volume11
Issue number10
DOIs
Publication statusPublished - 10 Oct 2016

Keywords

  • Statement selection
  • Susceptibility
  • Strategies
  • Asymmetry
  • Parties

Cite this

Holleman, Bregje ; Kamoen, Naomi ; Krouwel, Andre ; van de Pol, Jasper ; de Vreese, Claes. / Positive vs. Negative : The Impact of Question Polarity in Voting Advice Applications. In: PLoS ONE. 2016 ; Vol. 11, No. 10.
@article{d7122d91891d45bda0c1e683a305f6a6,
title = "Positive vs. Negative: The Impact of Question Polarity in Voting Advice Applications",
abstract = "Online Voting Advice Applications (VAAs) are survey-like instruments that help citizens to shape their political preferences and compare them with those of political parties. Especially in multi-party democracies, their increasing popularity indicates that VAAs play an important role in opinion formation for citizens, as well as in the public debate prior to elections. Hence, the objectivity and transparency of VAAs are crucial. In the design of VAAs, many choices have to be made. Extant research in survey methodology shows that the seemingly arbitrary choice to word questions positively (e.g., 'The city council should allow cars into the city centre') or negatively ('The city council should ban cars from the city centre') systematically affects the answers. This asymmetry in answers is in line with work on negativity bias in other areas of linguistics and psychology. Building on these findings, this study investigated whether question polarity also affects the answers to VAA statements. In a field experiment (N = 31,112) during the Dutch municipal elections we analysed the effects of polarity for 16 out of 30 VAA statements with a large variety of linguistic contrasts. Analyses show a significant effect of question wording for questions containing a wide range of implicit negations (such as 'forbid' vs. 'allow'), as well as for questions with explicit negations (e.g., 'not'). These effects of question polarity are found especially for VAA users with lower levels of political sophistication. As these citizens are an important target group for Voting Advice Applications, this stresses the need for VAA builders to be sensitive to wording choices when designing VAAs. This study is the first to show such consistent wording effects not only for political attitude questions with implicit negations in VAAs, but also for political questions containing explicit negations.",
keywords = "Statement selection, Susceptibility, Strategies, Asymmetry, Parties",
author = "Bregje Holleman and Naomi Kamoen and Andre Krouwel and {van de Pol}, Jasper and {de Vreese}, Claes",
year = "2016",
month = "10",
day = "10",
doi = "10.1371/journal.pone.0164184",
language = "English",
volume = "11",
journal = "PLoS ONE",
issn = "1932-6203",
publisher = "PUBLIC LIBRARY SCIENCE",
number = "10",

}

Positive vs. Negative : The Impact of Question Polarity in Voting Advice Applications. / Holleman, Bregje; Kamoen, Naomi; Krouwel, Andre; van de Pol, Jasper; de Vreese, Claes.

In: PLoS ONE, Vol. 11, No. 10, 0164184, 10.10.2016.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Positive vs. Negative

T2 - The Impact of Question Polarity in Voting Advice Applications

AU - Holleman, Bregje

AU - Kamoen, Naomi

AU - Krouwel, Andre

AU - van de Pol, Jasper

AU - de Vreese, Claes

PY - 2016/10/10

Y1 - 2016/10/10

N2 - Online Voting Advice Applications (VAAs) are survey-like instruments that help citizens to shape their political preferences and compare them with those of political parties. Especially in multi-party democracies, their increasing popularity indicates that VAAs play an important role in opinion formation for citizens, as well as in the public debate prior to elections. Hence, the objectivity and transparency of VAAs are crucial. In the design of VAAs, many choices have to be made. Extant research in survey methodology shows that the seemingly arbitrary choice to word questions positively (e.g., 'The city council should allow cars into the city centre') or negatively ('The city council should ban cars from the city centre') systematically affects the answers. This asymmetry in answers is in line with work on negativity bias in other areas of linguistics and psychology. Building on these findings, this study investigated whether question polarity also affects the answers to VAA statements. In a field experiment (N = 31,112) during the Dutch municipal elections we analysed the effects of polarity for 16 out of 30 VAA statements with a large variety of linguistic contrasts. Analyses show a significant effect of question wording for questions containing a wide range of implicit negations (such as 'forbid' vs. 'allow'), as well as for questions with explicit negations (e.g., 'not'). These effects of question polarity are found especially for VAA users with lower levels of political sophistication. As these citizens are an important target group for Voting Advice Applications, this stresses the need for VAA builders to be sensitive to wording choices when designing VAAs. This study is the first to show such consistent wording effects not only for political attitude questions with implicit negations in VAAs, but also for political questions containing explicit negations.

AB - Online Voting Advice Applications (VAAs) are survey-like instruments that help citizens to shape their political preferences and compare them with those of political parties. Especially in multi-party democracies, their increasing popularity indicates that VAAs play an important role in opinion formation for citizens, as well as in the public debate prior to elections. Hence, the objectivity and transparency of VAAs are crucial. In the design of VAAs, many choices have to be made. Extant research in survey methodology shows that the seemingly arbitrary choice to word questions positively (e.g., 'The city council should allow cars into the city centre') or negatively ('The city council should ban cars from the city centre') systematically affects the answers. This asymmetry in answers is in line with work on negativity bias in other areas of linguistics and psychology. Building on these findings, this study investigated whether question polarity also affects the answers to VAA statements. In a field experiment (N = 31,112) during the Dutch municipal elections we analysed the effects of polarity for 16 out of 30 VAA statements with a large variety of linguistic contrasts. Analyses show a significant effect of question wording for questions containing a wide range of implicit negations (such as 'forbid' vs. 'allow'), as well as for questions with explicit negations (e.g., 'not'). These effects of question polarity are found especially for VAA users with lower levels of political sophistication. As these citizens are an important target group for Voting Advice Applications, this stresses the need for VAA builders to be sensitive to wording choices when designing VAAs. This study is the first to show such consistent wording effects not only for political attitude questions with implicit negations in VAAs, but also for political questions containing explicit negations.

KW - Statement selection

KW - Susceptibility

KW - Strategies

KW - Asymmetry

KW - Parties

U2 - 10.1371/journal.pone.0164184

DO - 10.1371/journal.pone.0164184

M3 - Article

VL - 11

JO - PLoS ONE

JF - PLoS ONE

SN - 1932-6203

IS - 10

M1 - 0164184

ER -