Improving the assessment of implicit motives using IRT

Cultural differences and differential item functioning

Malte Runge*, J. Lang, A. Chasiotis, Jan Hofer

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.

Original languageEnglish
Pages (from-to)414-424
JournalJournal of Personality Assessment
Volume101
Issue number4
DOIs
Publication statusPublished - 2019

Fingerprint

Costa Rica
Germany
Cues
Surveys and Questionnaires

Keywords

  • ACHIEVEMENT
  • CAMEROON
  • CONGRUENCE
  • COSTA-RICA
  • INTERNAL CONSISTENCY
  • LIFE SATISFACTION
  • MODEL
  • MOTIVATION
  • PERSONALITY
  • RESPONSE THEORY

Cite this

@article{6b61b5463ec44aebafed4d5afdf42399,
title = "Improving the assessment of implicit motives using IRT: Cultural differences and differential item functioning",
abstract = "Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.",
keywords = "ACHIEVEMENT, CAMEROON, CONGRUENCE, COSTA-RICA, INTERNAL CONSISTENCY, LIFE SATISFACTION, MODEL, MOTIVATION, PERSONALITY, RESPONSE THEORY",
author = "Malte Runge and J. Lang and A. Chasiotis and Jan Hofer",
year = "2019",
doi = "10.1080/00223891.2017.1418748",
language = "English",
volume = "101",
pages = "414--424",
journal = "Journal of Personality Assessment",
issn = "0022-3891",
publisher = "ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD",
number = "4",

}

Improving the assessment of implicit motives using IRT : Cultural differences and differential item functioning. / Runge, Malte; Lang, J.; Chasiotis, A.; Hofer, Jan.

In: Journal of Personality Assessment, Vol. 101, No. 4, 2019, p. 414-424.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Improving the assessment of implicit motives using IRT

T2 - Cultural differences and differential item functioning

AU - Runge, Malte

AU - Lang, J.

AU - Chasiotis, A.

AU - Hofer, Jan

PY - 2019

Y1 - 2019

N2 - Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.

AB - Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.

KW - ACHIEVEMENT

KW - CAMEROON

KW - CONGRUENCE

KW - COSTA-RICA

KW - INTERNAL CONSISTENCY

KW - LIFE SATISFACTION

KW - MODEL

KW - MOTIVATION

KW - PERSONALITY

KW - RESPONSE THEORY

UR - https://app-eu.readspeaker.com/cgi-bin/rsent?customerid=10118&lang=en_us&readclass=rs_readArea&url=https%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.1080%2F00223891.2017.1418748

U2 - 10.1080/00223891.2017.1418748

DO - 10.1080/00223891.2017.1418748

M3 - Article

VL - 101

SP - 414

EP - 424

JO - Journal of Personality Assessment

JF - Journal of Personality Assessment

SN - 0022-3891

IS - 4

ER -