Sample size requirements for traditional and regression-based norms

H.E.M. Oosterhuis, L.A. van der Ark, K. Sijtsma

Research output: Contribution to journalArticleScientificpeer-review

24 Citations (Scopus)

Abstract

Test norms enable determining the position of an individual test taker in the group. The most frequently used approach to obtain test norms is traditional norming. Regression-based norming may be more efficient than traditional norming and is rapidly growing in popularity, but little is known about its technical properties. A simulation study was conducted to compare the sample size requirements for traditional and regression-based norming by examining the 95% interpercentile ranges for percentile estimates as a function of sample size, norming method, size of covariate effects on the test score, test length, and number of answer categories in an item. Provided the assumptions of the linear regression model hold in the data, for a subdivision of the total group into eight equal-size subgroups, we found that regression-based norming requires samples 2.5 to 5.5 times smaller than traditional norming. Sample size requirements are presented for each norming method, test length, and number of answer categories. We emphasize that additional research is needed to establish sample size requirements when the assumptions of the linear regression model are violated.
Original languageEnglish
Pages (from-to)191-202
JournalAssessment
Volume23
Issue number2
DOIs
Publication statusPublished - 2016

Fingerprint Dive into the research topics of 'Sample size requirements for traditional and regression-based norms'. Together they form a unique fingerprint.

  • Cite this

    Oosterhuis, H. E. M., van der Ark, L. A., & Sijtsma, K. (2016). Sample size requirements for traditional and regression-based norms. Assessment, 23(2), 191-202. https://doi.org/10.1177/1073191115580638