Exploring response differences between face-to-face and web surveys

A qualitative comparative analysis of the Dutch European Values Survey 2008

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Can existing longitudinal surveys profit from the (financial) advantages of web surveying by switching survey mode from face-to-face interviews to web surveys? Before such a radical change in data collection procedure can be undertaken, it needs to be established that mode effects cannot confound the responses to the survey items. To this end, the responses of the Dutch European Values Study of 2008 were compared to the responses of a time parallel web survey. The responses on 163 of the 256 items differed significantly across modes. To explain these response differences between modes, an exploratory crisp set qualitative comparative analysis approach was used. Five sufficient conditions—combinations of survey mode characteristics—but no necessary conditions for response differences between survey modes were found. Two survey characteristics were neither necessary nor sufficient to produce the outcome. Results suggest that switching modes may affect comparability between waves in a longitudinal survey.
Keywords: mode effects, face-to-face surveys, web surveys, internet surveys, crisp set qualitative comparative analysis
Original languageEnglish
Pages (from-to)319-338
JournalField Methods
Volume25
Issue number4
DOIs
Publication statusPublished - 2013

Fingerprint

Values
EVS
online survey
profit
interview

Cite this

@article{a830595fba184c47892da4c1ec8dec1f,
title = "Exploring response differences between face-to-face and web surveys: A qualitative comparative analysis of the Dutch European Values Survey 2008",
abstract = "Can existing longitudinal surveys profit from the (financial) advantages of web surveying by switching survey mode from face-to-face interviews to web surveys? Before such a radical change in data collection procedure can be undertaken, it needs to be established that mode effects cannot confound the responses to the survey items. To this end, the responses of the Dutch European Values Study of 2008 were compared to the responses of a time parallel web survey. The responses on 163 of the 256 items differed significantly across modes. To explain these response differences between modes, an exploratory crisp set qualitative comparative analysis approach was used. Five sufficient conditions—combinations of survey mode characteristics—but no necessary conditions for response differences between survey modes were found. Two survey characteristics were neither necessary nor sufficient to produce the outcome. Results suggest that switching modes may affect comparability between waves in a longitudinal survey.Keywords: mode effects, face-to-face surveys, web surveys, internet surveys, crisp set qualitative comparative analysis",
author = "M. Bennink and G.B.D. Moors and J.P.T.M. Gelissen",
year = "2013",
doi = "10.1177/1525822x12472875",
language = "English",
volume = "25",
pages = "319--338",
journal = "Field Methods",
issn = "1525-822X",
publisher = "Sage Publications, Inc.",
number = "4",

}

Exploring response differences between face-to-face and web surveys : A qualitative comparative analysis of the Dutch European Values Survey 2008. / Bennink, M.; Moors, G.B.D.; Gelissen, J.P.T.M.

In: Field Methods, Vol. 25, No. 4, 2013, p. 319-338.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Exploring response differences between face-to-face and web surveys

T2 - A qualitative comparative analysis of the Dutch European Values Survey 2008

AU - Bennink, M.

AU - Moors, G.B.D.

AU - Gelissen, J.P.T.M.

PY - 2013

Y1 - 2013

N2 - Can existing longitudinal surveys profit from the (financial) advantages of web surveying by switching survey mode from face-to-face interviews to web surveys? Before such a radical change in data collection procedure can be undertaken, it needs to be established that mode effects cannot confound the responses to the survey items. To this end, the responses of the Dutch European Values Study of 2008 were compared to the responses of a time parallel web survey. The responses on 163 of the 256 items differed significantly across modes. To explain these response differences between modes, an exploratory crisp set qualitative comparative analysis approach was used. Five sufficient conditions—combinations of survey mode characteristics—but no necessary conditions for response differences between survey modes were found. Two survey characteristics were neither necessary nor sufficient to produce the outcome. Results suggest that switching modes may affect comparability between waves in a longitudinal survey.Keywords: mode effects, face-to-face surveys, web surveys, internet surveys, crisp set qualitative comparative analysis

AB - Can existing longitudinal surveys profit from the (financial) advantages of web surveying by switching survey mode from face-to-face interviews to web surveys? Before such a radical change in data collection procedure can be undertaken, it needs to be established that mode effects cannot confound the responses to the survey items. To this end, the responses of the Dutch European Values Study of 2008 were compared to the responses of a time parallel web survey. The responses on 163 of the 256 items differed significantly across modes. To explain these response differences between modes, an exploratory crisp set qualitative comparative analysis approach was used. Five sufficient conditions—combinations of survey mode characteristics—but no necessary conditions for response differences between survey modes were found. Two survey characteristics were neither necessary nor sufficient to produce the outcome. Results suggest that switching modes may affect comparability between waves in a longitudinal survey.Keywords: mode effects, face-to-face surveys, web surveys, internet surveys, crisp set qualitative comparative analysis

U2 - 10.1177/1525822x12472875

DO - 10.1177/1525822x12472875

M3 - Article

VL - 25

SP - 319

EP - 338

JO - Field Methods

JF - Field Methods

SN - 1525-822X

IS - 4

ER -