Improving the assessment of implicit motives using IRT: Cultural differences and differential item functioning

Malte Runge, J. Lang, A. Chasiotis, Jan Hofer

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014 Lang, J. W. B. (2014). A dynamic Thurstonian item response theory of motive expression in the picture story exercise: Solving the internal consistency paradox of the PSE. Psychological Review, 121, 481–500. doi:10.1037/a0037011[Crossref], [PubMed], [Web of Science ®], [Google Scholar]) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.
Original languageEnglish
Pages (from-to)1-11
JournalJournal of Personality Assessment
DOIs
Publication statusAccepted/In press - 2019

Fingerprint

Costa Rica
Germany
PubMed
Cues
Surveys and Questionnaires

Cite this

@article{6b61b5463ec44aebafed4d5afdf42399,
title = "Improving the assessment of implicit motives using IRT: Cultural differences and differential item functioning",
abstract = "Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014 Lang, J. W. B. (2014). A dynamic Thurstonian item response theory of motive expression in the picture story exercise: Solving the internal consistency paradox of the PSE. Psychological Review, 121, 481–500. doi:10.1037/a0037011[Crossref], [PubMed], [Web of Science {\circledR}], [Google Scholar]) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.",
author = "Malte Runge and J. Lang and A. Chasiotis and Jan Hofer",
year = "2019",
doi = "10.1080/00223891.2017.1418748",
language = "English",
pages = "1--11",
journal = "Journal of Personality Assessment",
issn = "0022-3891",
publisher = "ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD",

}

Improving the assessment of implicit motives using IRT : Cultural differences and differential item functioning. / Runge, Malte; Lang, J.; Chasiotis, A.; Hofer, Jan.

In: Journal of Personality Assessment, 2019, p. 1-11.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Improving the assessment of implicit motives using IRT

T2 - Cultural differences and differential item functioning

AU - Runge, Malte

AU - Lang, J.

AU - Chasiotis, A.

AU - Hofer, Jan

PY - 2019

Y1 - 2019

N2 - Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014 Lang, J. W. B. (2014). A dynamic Thurstonian item response theory of motive expression in the picture story exercise: Solving the internal consistency paradox of the PSE. Psychological Review, 121, 481–500. doi:10.1037/a0037011[Crossref], [PubMed], [Web of Science ®], [Google Scholar]) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.

AB - Researchers have long been interested in studying differences in implicit motive between different groups. Implicit motives are typically measured by scoring text that respondents have written in response to picture cues. Recently, research on the measurement of implicit motives has made progress through the application of a dynamic Thurstonian item-response theory model (DTM; Lang, 2014 Lang, J. W. B. (2014). A dynamic Thurstonian item response theory of motive expression in the picture story exercise: Solving the internal consistency paradox of the PSE. Psychological Review, 121, 481–500. doi:10.1037/a0037011[Crossref], [PubMed], [Web of Science ®], [Google Scholar]) that captures 2 basic motivational processes in motivational research: motive competition and dynamic reduction of motive strength after a motive has been acted out. In this article, the authors use the DTM to investigate differential item functioning (DIF) in implicit motive measures. The article first discusses DIF in the context of the DTM. The authors then conduct a DIF analysis of data from a study that used a picture set of the Operant Motive Test (OMT; Kuhl & Scheffer, 2002) with participants from Cameroon, Germany, and Costa Rica. Results showed no evidence of DIF in 9 pictures and some evidence for DIF in 3 pictures. The authors show a partial invariance model can be specified and use this partial invariance model to study latent mean differences between Cameroon, Germany, and Costa Rica. The discussion focuses on the use of IRT DIF methods in future research on implicit motives.

UR - https://app-eu.readspeaker.com/cgi-bin/rsent?customerid=10118&lang=en_us&readclass=rs_readArea&url=https%3A%2F%2Fwww.tandfonline.com%2Fdoi%2Ffull%2F10.1080%2F00223891.2017.1418748

U2 - 10.1080/00223891.2017.1418748

DO - 10.1080/00223891.2017.1418748

M3 - Article

SP - 1

EP - 11

JO - Journal of Personality Assessment

JF - Journal of Personality Assessment

SN - 0022-3891

ER -