Controlling for response order effects in ranking items using latent choice factor modeling

I.P.M. Vriens*, G.B.D. Moors, J.P.T.M. Gelissen, J. K. Vermunt

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

10 Citations (Scopus)


Measuring values in sociological research sometimes involves the use of ranking data. A disadvantage of a ranking assignment is that the order in which the items are presented might influence the choice preferences of respondents regardless of the content being measured. The standard procedure to rule out such effects is to randomize the order of items across respondents. However, implementing this design may be impractical and the biasing impact of a response order effect cannot be evaluated. We use a latent choice factor (LCF) model that allows statistically controlling for response order effects. Furthermore, the model adequately deals with the known issue of ipsativity of ranking data. Applying this model to a Dutch survey on work values, we show that a primacy effect accounts for response order bias in item preferences. Our findings demonstrate the usefulness of the LCF model in modeling ranking data while taking into account particular response biases.
Original languageEnglish
Pages (from-to)218-241
JournalSociological Methods & Research
Issue number2
Publication statusPublished - 2017


Dive into the research topics of 'Controlling for response order effects in ranking items using latent choice factor modeling'. Together they form a unique fingerprint.

Cite this