Can response speed be fixed, and does this lead to unconfounded measurement of ability?

M. Bolsinova, J. Tijmstra

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Goldhammer (this issue) proposes an interesting approach to dealing with the speededness of item responses. Rather than modeling speed as a latent variable that varies from person to person, he proposes to use experimental conditions that are expected to fix the speed, thereby eliminating individual differences on this dimension in order to make unconfounded comparisons of a person’s ability possible. We applaud his efforts for considering the gains that can be obtained by changing the test conditions to better match the measurement aims of ability tests, rather than just considering altering the measurement model. We agree that the model provides an interesting theoretical exploration into possible conditions under which the measurement of speed and ability would not be confounded by the speed ability compromise. However, the model is only able to achieve this unconfounded measurement of ability by imposing a number of restrictive assumptions. We believe that the merit of the approach will depend on the extent to which these assumptions are likely to be met in practice. We will discuss two main concerns: issues with the practical realizability of fixing effective speed and consequences of fixing speed for the measurement of ability.
Original languageEnglish
Pages (from-to)165-168
JournalMeasurement: Interdisciplinary Research and Perspectives
Volume13
Issue number3-4
DOIs
Publication statusPublished - 2015

Fingerprint

ability
Person
human being
Individual Differences
Realizability
Latent Variables
compromise
Likely
Vary
Model
Modeling

Cite this

@article{9d8fab61bcf14ad1a591b7d99bfad563,
title = "Can response speed be fixed, and does this lead to unconfounded measurement of ability?",
abstract = "Goldhammer (this issue) proposes an interesting approach to dealing with the speededness of item responses. Rather than modeling speed as a latent variable that varies from person to person, he proposes to use experimental conditions that are expected to fix the speed, thereby eliminating individual differences on this dimension in order to make unconfounded comparisons of a person’s ability possible. We applaud his efforts for considering the gains that can be obtained by changing the test conditions to better match the measurement aims of ability tests, rather than just considering altering the measurement model. We agree that the model provides an interesting theoretical exploration into possible conditions under which the measurement of speed and ability would not be confounded by the speed ability compromise. However, the model is only able to achieve this unconfounded measurement of ability by imposing a number of restrictive assumptions. We believe that the merit of the approach will depend on the extent to which these assumptions are likely to be met in practice. We will discuss two main concerns: issues with the practical realizability of fixing effective speed and consequences of fixing speed for the measurement of ability.",
author = "M. Bolsinova and J. Tijmstra",
year = "2015",
doi = "10.1080/15366367.2015.1105080",
language = "English",
volume = "13",
pages = "165--168",
journal = "Measurement: Interdisciplinary Research and Perspectives",
issn = "1536-6367",
publisher = "Taylor and Francis Ltd.",
number = "3-4",

}

Can response speed be fixed, and does this lead to unconfounded measurement of ability? / Bolsinova, M.; Tijmstra, J.

In: Measurement: Interdisciplinary Research and Perspectives, Vol. 13, No. 3-4, 2015, p. 165-168.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Can response speed be fixed, and does this lead to unconfounded measurement of ability?

AU - Bolsinova, M.

AU - Tijmstra, J.

PY - 2015

Y1 - 2015

N2 - Goldhammer (this issue) proposes an interesting approach to dealing with the speededness of item responses. Rather than modeling speed as a latent variable that varies from person to person, he proposes to use experimental conditions that are expected to fix the speed, thereby eliminating individual differences on this dimension in order to make unconfounded comparisons of a person’s ability possible. We applaud his efforts for considering the gains that can be obtained by changing the test conditions to better match the measurement aims of ability tests, rather than just considering altering the measurement model. We agree that the model provides an interesting theoretical exploration into possible conditions under which the measurement of speed and ability would not be confounded by the speed ability compromise. However, the model is only able to achieve this unconfounded measurement of ability by imposing a number of restrictive assumptions. We believe that the merit of the approach will depend on the extent to which these assumptions are likely to be met in practice. We will discuss two main concerns: issues with the practical realizability of fixing effective speed and consequences of fixing speed for the measurement of ability.

AB - Goldhammer (this issue) proposes an interesting approach to dealing with the speededness of item responses. Rather than modeling speed as a latent variable that varies from person to person, he proposes to use experimental conditions that are expected to fix the speed, thereby eliminating individual differences on this dimension in order to make unconfounded comparisons of a person’s ability possible. We applaud his efforts for considering the gains that can be obtained by changing the test conditions to better match the measurement aims of ability tests, rather than just considering altering the measurement model. We agree that the model provides an interesting theoretical exploration into possible conditions under which the measurement of speed and ability would not be confounded by the speed ability compromise. However, the model is only able to achieve this unconfounded measurement of ability by imposing a number of restrictive assumptions. We believe that the merit of the approach will depend on the extent to which these assumptions are likely to be met in practice. We will discuss two main concerns: issues with the practical realizability of fixing effective speed and consequences of fixing speed for the measurement of ability.

U2 - 10.1080/15366367.2015.1105080

DO - 10.1080/15366367.2015.1105080

M3 - Article

VL - 13

SP - 165

EP - 168

JO - Measurement: Interdisciplinary Research and Perspectives

JF - Measurement: Interdisciplinary Research and Perspectives

SN - 1536-6367

IS - 3-4

ER -