The effect of differential motivation on IRT linking

M.A. Mittelhaëuser, A.A. Béguin, K. Sijtsma

Research output: Contribution to journalArticleScientificpeer-review

Abstract

The purpose of this study was to investigate whether simulated differential motivation between the stakes for operational tests and anchor items produces an invalid linking result if the Rasch model is used to link the operational tests. This was done for an external anchor design and a variation of a pretest design. The study also investigated whether a constrained mixture Rasch model could identify latent classes in such a way that one latent class represented high-stakes responding while the other represented low-stakes responding. The results indicated that for an external anchor design, the Rasch linking result was only biased when the motivation level differed between the subpopulations to which the anchor items were administered. However, the mixture Rasch model did not identify the classes representing low-stakes and high-stakes responding. When a pretest design was used to link the operational tests by means of a Rasch model, the linking result was found to be biased in each condition. Bias increased as percentage of students showing low-stakes responding to the anchor items increased. The mixture Rasch model only identified the classes representing low-stakes and high-stakes responding under a limited number of conditions.
Original languageEnglish
Pages (from-to)339-358
JournalJournal of Educational Measurement
Volume52
Issue number3
DOIs
Publication statusPublished - 2015

Fingerprint

lower class
trend
student

Cite this

Mittelhaëuser, M. A., Béguin, A. A., & Sijtsma, K. (2015). The effect of differential motivation on IRT linking. Journal of Educational Measurement, 52(3), 339-358. https://doi.org/10.1111/jedm.12080
Mittelhaëuser, M.A. ; Béguin, A.A. ; Sijtsma, K. / The effect of differential motivation on IRT linking. In: Journal of Educational Measurement. 2015 ; Vol. 52, No. 3. pp. 339-358.
@article{f7e6fca9666d41fdb198074d4d129ece,
title = "The effect of differential motivation on IRT linking",
abstract = "The purpose of this study was to investigate whether simulated differential motivation between the stakes for operational tests and anchor items produces an invalid linking result if the Rasch model is used to link the operational tests. This was done for an external anchor design and a variation of a pretest design. The study also investigated whether a constrained mixture Rasch model could identify latent classes in such a way that one latent class represented high-stakes responding while the other represented low-stakes responding. The results indicated that for an external anchor design, the Rasch linking result was only biased when the motivation level differed between the subpopulations to which the anchor items were administered. However, the mixture Rasch model did not identify the classes representing low-stakes and high-stakes responding. When a pretest design was used to link the operational tests by means of a Rasch model, the linking result was found to be biased in each condition. Bias increased as percentage of students showing low-stakes responding to the anchor items increased. The mixture Rasch model only identified the classes representing low-stakes and high-stakes responding under a limited number of conditions.",
author = "M.A. Mittelha{\"e}user and A.A. B{\'e}guin and K. Sijtsma",
year = "2015",
doi = "10.1111/jedm.12080",
language = "English",
volume = "52",
pages = "339--358",
journal = "Journal of Educational Measurement",
issn = "0022-0655",
publisher = "Wiley-Blackwell",
number = "3",

}

Mittelhaëuser, MA, Béguin, AA & Sijtsma, K 2015, 'The effect of differential motivation on IRT linking', Journal of Educational Measurement, vol. 52, no. 3, pp. 339-358. https://doi.org/10.1111/jedm.12080

The effect of differential motivation on IRT linking. / Mittelhaëuser, M.A.; Béguin, A.A.; Sijtsma, K.

In: Journal of Educational Measurement, Vol. 52, No. 3, 2015, p. 339-358.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - The effect of differential motivation on IRT linking

AU - Mittelhaëuser, M.A.

AU - Béguin, A.A.

AU - Sijtsma, K.

PY - 2015

Y1 - 2015

N2 - The purpose of this study was to investigate whether simulated differential motivation between the stakes for operational tests and anchor items produces an invalid linking result if the Rasch model is used to link the operational tests. This was done for an external anchor design and a variation of a pretest design. The study also investigated whether a constrained mixture Rasch model could identify latent classes in such a way that one latent class represented high-stakes responding while the other represented low-stakes responding. The results indicated that for an external anchor design, the Rasch linking result was only biased when the motivation level differed between the subpopulations to which the anchor items were administered. However, the mixture Rasch model did not identify the classes representing low-stakes and high-stakes responding. When a pretest design was used to link the operational tests by means of a Rasch model, the linking result was found to be biased in each condition. Bias increased as percentage of students showing low-stakes responding to the anchor items increased. The mixture Rasch model only identified the classes representing low-stakes and high-stakes responding under a limited number of conditions.

AB - The purpose of this study was to investigate whether simulated differential motivation between the stakes for operational tests and anchor items produces an invalid linking result if the Rasch model is used to link the operational tests. This was done for an external anchor design and a variation of a pretest design. The study also investigated whether a constrained mixture Rasch model could identify latent classes in such a way that one latent class represented high-stakes responding while the other represented low-stakes responding. The results indicated that for an external anchor design, the Rasch linking result was only biased when the motivation level differed between the subpopulations to which the anchor items were administered. However, the mixture Rasch model did not identify the classes representing low-stakes and high-stakes responding. When a pretest design was used to link the operational tests by means of a Rasch model, the linking result was found to be biased in each condition. Bias increased as percentage of students showing low-stakes responding to the anchor items increased. The mixture Rasch model only identified the classes representing low-stakes and high-stakes responding under a limited number of conditions.

U2 - 10.1111/jedm.12080

DO - 10.1111/jedm.12080

M3 - Article

VL - 52

SP - 339

EP - 358

JO - Journal of Educational Measurement

JF - Journal of Educational Measurement

SN - 0022-0655

IS - 3

ER -