TY - JOUR
T1 - Assessing and accounting for measurement in intensive longitudinal studies
T2 - Current Practices, Considerations, and Avenues for Improvement
AU - Vogelsmeier, L.V.D.E.
AU - Jongerling, J.
AU - Maassen, E.
PY - 2024
Y1 - 2024
N2 - Purpose: Intensive longitudinal studies, in which participants complete questionnaires multiple times a day over an extended period, are increasingly popular in the social sciences in general and quality-of-life research in particular. The intensive longitudinal methods allow for studying the dynamics of constructs (e.g., how much patient-reported outcomes vary across time). These methods promise higher ecological validity and lower recall bias than traditional methods that question participants only once, since the high frequency means that participants complete questionnaires in their everyday lives and do not have to retrospectively report about a large time interval. However, to ensure the validity of the results obtained from analyzing the intensive longitudinal data (ILD), greater awareness and understanding of appropriate measurement practices are needed. Method: We surveyed 42 researchers experienced with ILD regarding their measurement practices and reasons for suboptimal practices. Results: Results showed that researchers typically do not use measures validated specifically for ILD. Participants assessing the psychometric properties and invariance of measures in their current studies was even less common, as was accounting for these properties when analyzing dynamics. This was mainly because participants did not have the necessary knowledge to conduct these assessments or were unaware of their importance for drawing valid inferences. Open science practices, in contrast, appear reasonably well ingrained in ILD studies. Conclusion: Measurement practices in ILD still need improvement in some key areas; we provide recommendations in order to create a solid foundation for measuring and analyzing psychological constructs.
AB - Purpose: Intensive longitudinal studies, in which participants complete questionnaires multiple times a day over an extended period, are increasingly popular in the social sciences in general and quality-of-life research in particular. The intensive longitudinal methods allow for studying the dynamics of constructs (e.g., how much patient-reported outcomes vary across time). These methods promise higher ecological validity and lower recall bias than traditional methods that question participants only once, since the high frequency means that participants complete questionnaires in their everyday lives and do not have to retrospectively report about a large time interval. However, to ensure the validity of the results obtained from analyzing the intensive longitudinal data (ILD), greater awareness and understanding of appropriate measurement practices are needed. Method: We surveyed 42 researchers experienced with ILD regarding their measurement practices and reasons for suboptimal practices. Results: Results showed that researchers typically do not use measures validated specifically for ILD. Participants assessing the psychometric properties and invariance of measures in their current studies was even less common, as was accounting for these properties when analyzing dynamics. This was mainly because participants did not have the necessary knowledge to conduct these assessments or were unaware of their importance for drawing valid inferences. Open science practices, in contrast, appear reasonably well ingrained in ILD studies. Conclusion: Measurement practices in ILD still need improvement in some key areas; we provide recommendations in order to create a solid foundation for measuring and analyzing psychological constructs.
KW - Experience sampling methodology
KW - Invariance
KW - Measurement
KW - Reliability
UR - http://www.scopus.com/inward/record.url?scp=85195835037&partnerID=8YFLogxK
U2 - 10.1007/s11136-024-03678-0
DO - 10.1007/s11136-024-03678-0
M3 - Article
C2 - 38869735
SN - 0962-9343
VL - 33
SP - 2107
EP - 2118
JO - Quality of Life Research
JF - Quality of Life Research
ER -