Assessing individual change using short tests and questionnaires

P.M. Kruyen, W.H.M. Emons, K. Sijtsma

Research output: Contribution to journalArticleScientificpeer-review

Abstract

In clinical contexts, tests and questionnaires are used to assess change at the level of the individual client. The difference between an individual client’s posttreatment and pretreatment scores is used to decide about the degree to which the client benefited from a treatment. Because administration time is limited, clinicians prefer using short tests consisting of, say, at the most 15 items. Simulation research showed that shorter tests produce a higher risk of drawing incorrect conclusions about change in individual clients. Based on the simulation results, the authors provide guidelines for the number of items minimally required to reliably assess individual change. Using item response theory, they also provide guidelines for the minimally required local test information for individual-change assessment.
Keywords: assessment of individual change, change-score reliability, measurement precision, test shortening
Original languageEnglish
Pages (from-to)201-216
JournalApplied Psychological Measurement
Volume38
Issue number3
DOIs
Publication statusPublished - 2014

Fingerprint

questionnaire
Individuality
simulation
Surveys and Questionnaires

Cite this

Kruyen, P.M. ; Emons, W.H.M. ; Sijtsma, K. / Assessing individual change using short tests and questionnaires. In: Applied Psychological Measurement. 2014 ; Vol. 38, No. 3. pp. 201-216.
@article{9836d8ca6e654476b0a6ddcfdb1ad0fb,
title = "Assessing individual change using short tests and questionnaires",
abstract = "In clinical contexts, tests and questionnaires are used to assess change at the level of the individual client. The difference between an individual client’s posttreatment and pretreatment scores is used to decide about the degree to which the client benefited from a treatment. Because administration time is limited, clinicians prefer using short tests consisting of, say, at the most 15 items. Simulation research showed that shorter tests produce a higher risk of drawing incorrect conclusions about change in individual clients. Based on the simulation results, the authors provide guidelines for the number of items minimally required to reliably assess individual change. Using item response theory, they also provide guidelines for the minimally required local test information for individual-change assessment.Keywords: assessment of individual change, change-score reliability, measurement precision, test shortening",
author = "P.M. Kruyen and W.H.M. Emons and K. Sijtsma",
year = "2014",
doi = "10.1177/0146621613510061",
language = "English",
volume = "38",
pages = "201--216",
journal = "Applied Psychological Measurement",
issn = "0146-6216",
publisher = "SAGE Publications Inc.",
number = "3",

}

Assessing individual change using short tests and questionnaires. / Kruyen, P.M.; Emons, W.H.M.; Sijtsma, K.

In: Applied Psychological Measurement, Vol. 38, No. 3, 2014, p. 201-216.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Assessing individual change using short tests and questionnaires

AU - Kruyen, P.M.

AU - Emons, W.H.M.

AU - Sijtsma, K.

PY - 2014

Y1 - 2014

N2 - In clinical contexts, tests and questionnaires are used to assess change at the level of the individual client. The difference between an individual client’s posttreatment and pretreatment scores is used to decide about the degree to which the client benefited from a treatment. Because administration time is limited, clinicians prefer using short tests consisting of, say, at the most 15 items. Simulation research showed that shorter tests produce a higher risk of drawing incorrect conclusions about change in individual clients. Based on the simulation results, the authors provide guidelines for the number of items minimally required to reliably assess individual change. Using item response theory, they also provide guidelines for the minimally required local test information for individual-change assessment.Keywords: assessment of individual change, change-score reliability, measurement precision, test shortening

AB - In clinical contexts, tests and questionnaires are used to assess change at the level of the individual client. The difference between an individual client’s posttreatment and pretreatment scores is used to decide about the degree to which the client benefited from a treatment. Because administration time is limited, clinicians prefer using short tests consisting of, say, at the most 15 items. Simulation research showed that shorter tests produce a higher risk of drawing incorrect conclusions about change in individual clients. Based on the simulation results, the authors provide guidelines for the number of items minimally required to reliably assess individual change. Using item response theory, they also provide guidelines for the minimally required local test information for individual-change assessment.Keywords: assessment of individual change, change-score reliability, measurement precision, test shortening

U2 - 10.1177/0146621613510061

DO - 10.1177/0146621613510061

M3 - Article

VL - 38

SP - 201

EP - 216

JO - Applied Psychological Measurement

JF - Applied Psychological Measurement

SN - 0146-6216

IS - 3

ER -