Can carelessness be captured? Assessing careless responding in attitudes toward novel stimuli

Morgan A. Conway, Brian O'Shea, Liz Redford, Gabrielle Pogge, Richard A. Klein, Kate A. Ratliff

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Detecting careless responding has the potential to improve the quality of data obtained from research participants. In three samples (ns = 570, 602, 210), we used multiple indices of careless responding to predict the strength of implicit and explicit attitudes formed toward novel social groups as well as error rates on the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998). We tested each measure of careless responding on its own, simultaneously with other predictors, and with Bayesian analyses. In all three samples, there were strong and consistent effects such that more careful participants made fewer overall errors on the IAT; however, careless responding did not consistently predict implicit and explicit attitudes formed toward novel social groups. These results suggest that caution should be exercised when removing participants based on indices of careless responding.
Original languageEnglish
Pages (from-to)468-498
JournalSocial Cognition
Volume37
Issue number5
DOIs
Publication statusPublished - Oct 2019

Fingerprint

Data Accuracy

Keywords

  • BEHAVIOR
  • COGNITION
  • EXPLICIT ATTITUDES
  • ILLUSORY CORRELATION
  • IMPLICIT ATTITUDES
  • MODEL
  • MULTIPLE PROCESSES
  • PROGRAM
  • SHIRKERS
  • attention
  • attitude formation
  • implicit attitudes
  • participant carelessness

Cite this

Conway, Morgan A. ; O'Shea, Brian ; Redford, Liz ; Pogge, Gabrielle ; Klein, Richard A. ; Ratliff, Kate A. / Can carelessness be captured? Assessing careless responding in attitudes toward novel stimuli. In: Social Cognition. 2019 ; Vol. 37, No. 5. pp. 468-498.
@article{1221433a69dc4f98a901f1805a41b926,
title = "Can carelessness be captured?: Assessing careless responding in attitudes toward novel stimuli",
abstract = "Detecting careless responding has the potential to improve the quality of data obtained from research participants. In three samples (ns = 570, 602, 210), we used multiple indices of careless responding to predict the strength of implicit and explicit attitudes formed toward novel social groups as well as error rates on the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998). We tested each measure of careless responding on its own, simultaneously with other predictors, and with Bayesian analyses. In all three samples, there were strong and consistent effects such that more careful participants made fewer overall errors on the IAT; however, careless responding did not consistently predict implicit and explicit attitudes formed toward novel social groups. These results suggest that caution should be exercised when removing participants based on indices of careless responding.",
keywords = "BEHAVIOR, COGNITION, EXPLICIT ATTITUDES, ILLUSORY CORRELATION, IMPLICIT ATTITUDES, MODEL, MULTIPLE PROCESSES, PROGRAM, SHIRKERS, attention, attitude formation, implicit attitudes, participant carelessness",
author = "Conway, {Morgan A.} and Brian O'Shea and Liz Redford and Gabrielle Pogge and Klein, {Richard A.} and Ratliff, {Kate A.}",
year = "2019",
month = "10",
doi = "10.1521/soco.2019.37.5.468",
language = "English",
volume = "37",
pages = "468--498",
journal = "Social Cognition",
issn = "0278-016X",
publisher = "Guilford Publications",
number = "5",

}

Can carelessness be captured? Assessing careless responding in attitudes toward novel stimuli. / Conway, Morgan A.; O'Shea, Brian; Redford, Liz; Pogge, Gabrielle; Klein, Richard A.; Ratliff, Kate A.

In: Social Cognition, Vol. 37, No. 5, 10.2019, p. 468-498.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Can carelessness be captured?

T2 - Assessing careless responding in attitudes toward novel stimuli

AU - Conway, Morgan A.

AU - O'Shea, Brian

AU - Redford, Liz

AU - Pogge, Gabrielle

AU - Klein, Richard A.

AU - Ratliff, Kate A.

PY - 2019/10

Y1 - 2019/10

N2 - Detecting careless responding has the potential to improve the quality of data obtained from research participants. In three samples (ns = 570, 602, 210), we used multiple indices of careless responding to predict the strength of implicit and explicit attitudes formed toward novel social groups as well as error rates on the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998). We tested each measure of careless responding on its own, simultaneously with other predictors, and with Bayesian analyses. In all three samples, there were strong and consistent effects such that more careful participants made fewer overall errors on the IAT; however, careless responding did not consistently predict implicit and explicit attitudes formed toward novel social groups. These results suggest that caution should be exercised when removing participants based on indices of careless responding.

AB - Detecting careless responding has the potential to improve the quality of data obtained from research participants. In three samples (ns = 570, 602, 210), we used multiple indices of careless responding to predict the strength of implicit and explicit attitudes formed toward novel social groups as well as error rates on the Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998). We tested each measure of careless responding on its own, simultaneously with other predictors, and with Bayesian analyses. In all three samples, there were strong and consistent effects such that more careful participants made fewer overall errors on the IAT; however, careless responding did not consistently predict implicit and explicit attitudes formed toward novel social groups. These results suggest that caution should be exercised when removing participants based on indices of careless responding.

KW - BEHAVIOR

KW - COGNITION

KW - EXPLICIT ATTITUDES

KW - ILLUSORY CORRELATION

KW - IMPLICIT ATTITUDES

KW - MODEL

KW - MULTIPLE PROCESSES

KW - PROGRAM

KW - SHIRKERS

KW - attention

KW - attitude formation

KW - implicit attitudes

KW - participant carelessness

U2 - 10.1521/soco.2019.37.5.468

DO - 10.1521/soco.2019.37.5.468

M3 - Article

VL - 37

SP - 468

EP - 498

JO - Social Cognition

JF - Social Cognition

SN - 0278-016X

IS - 5

ER -