Test-retest reliability and practice effects of a computerized neuropsychological battery: A solution-oriented approach

Research output: Contribution to journalArticleScientificpeer-review

Abstract

This study examined test-retest reliabilities and (predictors of) practice effects of the widely used computerized neuropsychological battery CNS Vital Signs. The sample consisted of 158 Dutch healthy adults. At 3 and 12 months follow-up, 131 and 77 participants were retested. Results revealed low to high test-retest reliability coefficients for CNS VS' test and domain scores. Participants scored significantly higher on the domains of Cognitive Flexibility, Processing Speed, and Reaction Time at the 3-month retest. No significant differences in performance were found over the second interval. Age, education, and retest-interval were not significantly associated with practice effects. These results highlight the need for methods that evaluate performance over time while accounting for imperfect test-retest reliabilities and practice effects. We provided RCI-formulae for determining reliable change, which may be possible solution for future work facing the methodological issues of retesting.

Public Significance Statement

Imperfect test-retest reliability and practice effects must be taken into account when interpreting change in neuropsychological test scores over time, for example by applying RCI-formulae for the determination of reliable change.

Original languageEnglish
Pages (from-to)1652-1662
JournalPsychological Assessment
Volume30
Issue number12
DOIs
Publication statusPublished - 2018

Fingerprint

Vital Signs
Education

Keywords

  • ALTERNATE FORMS
  • CNS Vital Signs
  • METAANALYSES
  • cognition
  • computerized neuropsychological testing
  • reliable change
  • reproducibility of results

Cite this

@article{314a4cf1264e40f79df85c99f4ed9fdb,
title = "Test-retest reliability and practice effects of a computerized neuropsychological battery: A solution-oriented approach",
abstract = "This study examined test-retest reliabilities and (predictors of) practice effects of the widely used computerized neuropsychological battery CNS Vital Signs. The sample consisted of 158 Dutch healthy adults. At 3 and 12 months follow-up, 131 and 77 participants were retested. Results revealed low to high test-retest reliability coefficients for CNS VS' test and domain scores. Participants scored significantly higher on the domains of Cognitive Flexibility, Processing Speed, and Reaction Time at the 3-month retest. No significant differences in performance were found over the second interval. Age, education, and retest-interval were not significantly associated with practice effects. These results highlight the need for methods that evaluate performance over time while accounting for imperfect test-retest reliabilities and practice effects. We provided RCI-formulae for determining reliable change, which may be possible solution for future work facing the methodological issues of retesting.Public Significance StatementImperfect test-retest reliability and practice effects must be taken into account when interpreting change in neuropsychological test scores over time, for example by applying RCI-formulae for the determination of reliable change.",
keywords = "ALTERNATE FORMS, CNS Vital Signs, METAANALYSES, cognition, computerized neuropsychological testing, reliable change, reproducibility of results",
author = "S.J.M. Rijnen and {van der Linden}, S.D. and W.H.M. Emons and M.M. Sitskoorn and K. Gehring",
year = "2018",
doi = "10.1037/pas0000618",
language = "English",
volume = "30",
pages = "1652--1662",
journal = "Psychological Assessment",
issn = "1040-3590",
publisher = "American Psychological Association",
number = "12",

}

Test-retest reliability and practice effects of a computerized neuropsychological battery : A solution-oriented approach. / Rijnen, S.J.M.; van der Linden, S.D.; Emons, W.H.M.; Sitskoorn, M.M.; Gehring, K.

In: Psychological Assessment, Vol. 30, No. 12, 2018, p. 1652-1662.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Test-retest reliability and practice effects of a computerized neuropsychological battery

T2 - A solution-oriented approach

AU - Rijnen, S.J.M.

AU - van der Linden, S.D.

AU - Emons, W.H.M.

AU - Sitskoorn, M.M.

AU - Gehring, K.

PY - 2018

Y1 - 2018

N2 - This study examined test-retest reliabilities and (predictors of) practice effects of the widely used computerized neuropsychological battery CNS Vital Signs. The sample consisted of 158 Dutch healthy adults. At 3 and 12 months follow-up, 131 and 77 participants were retested. Results revealed low to high test-retest reliability coefficients for CNS VS' test and domain scores. Participants scored significantly higher on the domains of Cognitive Flexibility, Processing Speed, and Reaction Time at the 3-month retest. No significant differences in performance were found over the second interval. Age, education, and retest-interval were not significantly associated with practice effects. These results highlight the need for methods that evaluate performance over time while accounting for imperfect test-retest reliabilities and practice effects. We provided RCI-formulae for determining reliable change, which may be possible solution for future work facing the methodological issues of retesting.Public Significance StatementImperfect test-retest reliability and practice effects must be taken into account when interpreting change in neuropsychological test scores over time, for example by applying RCI-formulae for the determination of reliable change.

AB - This study examined test-retest reliabilities and (predictors of) practice effects of the widely used computerized neuropsychological battery CNS Vital Signs. The sample consisted of 158 Dutch healthy adults. At 3 and 12 months follow-up, 131 and 77 participants were retested. Results revealed low to high test-retest reliability coefficients for CNS VS' test and domain scores. Participants scored significantly higher on the domains of Cognitive Flexibility, Processing Speed, and Reaction Time at the 3-month retest. No significant differences in performance were found over the second interval. Age, education, and retest-interval were not significantly associated with practice effects. These results highlight the need for methods that evaluate performance over time while accounting for imperfect test-retest reliabilities and practice effects. We provided RCI-formulae for determining reliable change, which may be possible solution for future work facing the methodological issues of retesting.Public Significance StatementImperfect test-retest reliability and practice effects must be taken into account when interpreting change in neuropsychological test scores over time, for example by applying RCI-formulae for the determination of reliable change.

KW - ALTERNATE FORMS

KW - CNS Vital Signs

KW - METAANALYSES

KW - cognition

KW - computerized neuropsychological testing

KW - reliable change

KW - reproducibility of results

U2 - 10.1037/pas0000618

DO - 10.1037/pas0000618

M3 - Article

VL - 30

SP - 1652

EP - 1662

JO - Psychological Assessment

JF - Psychological Assessment

SN - 1040-3590

IS - 12

ER -