Minimum sample size requirements for Mokken scale analysis

J.H. Straat, L.A. van der Ark, K. Sijtsma

Research output: Contribution to journalArticleScientificpeer-review

Abstract

An automated item selection procedure in Mokken scale analysis partitions a set of items into one or more Mokken scales, if the data allow. Two algorithms are available that pursue the same goal of selecting Mokken scales of maximum length: Mokken’s original automated item selection procedure (AISP) and a genetic algorithm (GA). Minimum sample size requirements for the two algorithms to obtain stable, replicable results have not yet been established. In practical scale construction reported in the literature, we found that researchers used sample sizes ranging from 133 to 15,022 respondents. We investigated the effect of sample size on the assignment of items to the correct scales. Using a misclassification of 5% as a criterion, we found that the AISP and the GA algorithms minimally required 250 to 500 respondents when item quality was high and 1,250 to 1,750 respondents when item quality was low.
Keywords: automated item selection procedure, Mokken scale analysis, genetic algorithm for item selection, sample size requirements
Original languageEnglish
Pages (from-to)809-822
JournalEducational and Psychological Measurement
Volume74
DOIs
Publication statusPublished - 2014

Fingerprint

selection procedure
Sample Size
Genetic algorithms
Selection Procedures
Requirements
Genetic Algorithm
scale construction
Misclassification
Assignment
Partition
Surveys and Questionnaires

Cite this

Straat, J.H. ; van der Ark, L.A. ; Sijtsma, K. / Minimum sample size requirements for Mokken scale analysis. In: Educational and Psychological Measurement. 2014 ; Vol. 74. pp. 809-822.
@article{8df0fc335b634cf792d556f8c662866d,
title = "Minimum sample size requirements for Mokken scale analysis",
abstract = "An automated item selection procedure in Mokken scale analysis partitions a set of items into one or more Mokken scales, if the data allow. Two algorithms are available that pursue the same goal of selecting Mokken scales of maximum length: Mokken’s original automated item selection procedure (AISP) and a genetic algorithm (GA). Minimum sample size requirements for the two algorithms to obtain stable, replicable results have not yet been established. In practical scale construction reported in the literature, we found that researchers used sample sizes ranging from 133 to 15,022 respondents. We investigated the effect of sample size on the assignment of items to the correct scales. Using a misclassification of 5{\%} as a criterion, we found that the AISP and the GA algorithms minimally required 250 to 500 respondents when item quality was high and 1,250 to 1,750 respondents when item quality was low.Keywords: automated item selection procedure, Mokken scale analysis, genetic algorithm for item selection, sample size requirements",
author = "J.H. Straat and {van der Ark}, L.A. and K. Sijtsma",
year = "2014",
doi = "10.1177/0013164414529793",
language = "English",
volume = "74",
pages = "809--822",
journal = "Educational and Psychological Measurement",
issn = "0013-1644",
publisher = "Sage Publications, Inc.",

}

Minimum sample size requirements for Mokken scale analysis. / Straat, J.H.; van der Ark, L.A.; Sijtsma, K.

In: Educational and Psychological Measurement, Vol. 74, 2014, p. 809-822.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Minimum sample size requirements for Mokken scale analysis

AU - Straat, J.H.

AU - van der Ark, L.A.

AU - Sijtsma, K.

PY - 2014

Y1 - 2014

N2 - An automated item selection procedure in Mokken scale analysis partitions a set of items into one or more Mokken scales, if the data allow. Two algorithms are available that pursue the same goal of selecting Mokken scales of maximum length: Mokken’s original automated item selection procedure (AISP) and a genetic algorithm (GA). Minimum sample size requirements for the two algorithms to obtain stable, replicable results have not yet been established. In practical scale construction reported in the literature, we found that researchers used sample sizes ranging from 133 to 15,022 respondents. We investigated the effect of sample size on the assignment of items to the correct scales. Using a misclassification of 5% as a criterion, we found that the AISP and the GA algorithms minimally required 250 to 500 respondents when item quality was high and 1,250 to 1,750 respondents when item quality was low.Keywords: automated item selection procedure, Mokken scale analysis, genetic algorithm for item selection, sample size requirements

AB - An automated item selection procedure in Mokken scale analysis partitions a set of items into one or more Mokken scales, if the data allow. Two algorithms are available that pursue the same goal of selecting Mokken scales of maximum length: Mokken’s original automated item selection procedure (AISP) and a genetic algorithm (GA). Minimum sample size requirements for the two algorithms to obtain stable, replicable results have not yet been established. In practical scale construction reported in the literature, we found that researchers used sample sizes ranging from 133 to 15,022 respondents. We investigated the effect of sample size on the assignment of items to the correct scales. Using a misclassification of 5% as a criterion, we found that the AISP and the GA algorithms minimally required 250 to 500 respondents when item quality was high and 1,250 to 1,750 respondents when item quality was low.Keywords: automated item selection procedure, Mokken scale analysis, genetic algorithm for item selection, sample size requirements

U2 - 10.1177/0013164414529793

DO - 10.1177/0013164414529793

M3 - Article

VL - 74

SP - 809

EP - 822

JO - Educational and Psychological Measurement

JF - Educational and Psychological Measurement

SN - 0013-1644

ER -