What Cognitive Interviews Tell Us about Bias in Cross-Cultural Research: An Illustration Using Quality-of-life Items

Isabel Benitez*, Jose Luis Padilla, Fons van de Vijver, Amaya Cuevas

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

This study illustrates how the cognitive interviewing (CI) method can provide qualitative evidence of item, construct, and method bias in cross-cultural research. CI was conducted with participants from the Netherlands and Spain, who responded to quality-of-life (QoL) items included in international survey research projects. Qualitative findings indicate that, at the construct level, Spanish participants were more affected by the particular wording of the item stems, which made them modify their understanding of the intended constructs while answering, whereas Dutch participants were more focused on being consistent in their responses. At the item level, differences in the interpretation of key terms in QoL items were mainly related to translation and cultural issues. Method bias was manifested in the differential use of response options and anchor labels. Results of the study support the contribution and usefulness of CI to informing about the three types of bias from a qualitative approach.

Original languageEnglish
Pages (from-to)277-294
Number of pages18
JournalField Methods
Volume30
Issue number4
DOIs
Publication statusPublished - Nov 2018

Cite this

Benitez, Isabel ; Luis Padilla, Jose ; van de Vijver, Fons ; Cuevas, Amaya. / What Cognitive Interviews Tell Us about Bias in Cross-Cultural Research : An Illustration Using Quality-of-life Items. In: Field Methods. 2018 ; Vol. 30, No. 4. pp. 277-294.
@article{d56e984bb1ea46688270444b37fe3b57,
title = "What Cognitive Interviews Tell Us about Bias in Cross-Cultural Research: An Illustration Using Quality-of-life Items",
abstract = "This study illustrates how the cognitive interviewing (CI) method can provide qualitative evidence of item, construct, and method bias in cross-cultural research. CI was conducted with participants from the Netherlands and Spain, who responded to quality-of-life (QoL) items included in international survey research projects. Qualitative findings indicate that, at the construct level, Spanish participants were more affected by the particular wording of the item stems, which made them modify their understanding of the intended constructs while answering, whereas Dutch participants were more focused on being consistent in their responses. At the item level, differences in the interpretation of key terms in QoL items were mainly related to translation and cultural issues. Method bias was manifested in the differential use of response options and anchor labels. Results of the study support the contribution and usefulness of CI to informing about the three types of bias from a qualitative approach.",
author = "Isabel Benitez and {Luis Padilla}, Jose and {van de Vijver}, Fons and Amaya Cuevas",
year = "2018",
month = "11",
doi = "10.1177/1525822X18783961",
language = "English",
volume = "30",
pages = "277--294",
journal = "Field Methods",
issn = "1525-822X",
publisher = "Sage Publications, Inc.",
number = "4",

}

What Cognitive Interviews Tell Us about Bias in Cross-Cultural Research : An Illustration Using Quality-of-life Items. / Benitez, Isabel; Luis Padilla, Jose; van de Vijver, Fons; Cuevas, Amaya.

In: Field Methods, Vol. 30, No. 4, 11.2018, p. 277-294.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - What Cognitive Interviews Tell Us about Bias in Cross-Cultural Research

T2 - An Illustration Using Quality-of-life Items

AU - Benitez, Isabel

AU - Luis Padilla, Jose

AU - van de Vijver, Fons

AU - Cuevas, Amaya

PY - 2018/11

Y1 - 2018/11

N2 - This study illustrates how the cognitive interviewing (CI) method can provide qualitative evidence of item, construct, and method bias in cross-cultural research. CI was conducted with participants from the Netherlands and Spain, who responded to quality-of-life (QoL) items included in international survey research projects. Qualitative findings indicate that, at the construct level, Spanish participants were more affected by the particular wording of the item stems, which made them modify their understanding of the intended constructs while answering, whereas Dutch participants were more focused on being consistent in their responses. At the item level, differences in the interpretation of key terms in QoL items were mainly related to translation and cultural issues. Method bias was manifested in the differential use of response options and anchor labels. Results of the study support the contribution and usefulness of CI to informing about the three types of bias from a qualitative approach.

AB - This study illustrates how the cognitive interviewing (CI) method can provide qualitative evidence of item, construct, and method bias in cross-cultural research. CI was conducted with participants from the Netherlands and Spain, who responded to quality-of-life (QoL) items included in international survey research projects. Qualitative findings indicate that, at the construct level, Spanish participants were more affected by the particular wording of the item stems, which made them modify their understanding of the intended constructs while answering, whereas Dutch participants were more focused on being consistent in their responses. At the item level, differences in the interpretation of key terms in QoL items were mainly related to translation and cultural issues. Method bias was manifested in the differential use of response options and anchor labels. Results of the study support the contribution and usefulness of CI to informing about the three types of bias from a qualitative approach.

U2 - 10.1177/1525822X18783961

DO - 10.1177/1525822X18783961

M3 - Article

VL - 30

SP - 277

EP - 294

JO - Field Methods

JF - Field Methods

SN - 1525-822X

IS - 4

ER -