Speeding up without loss of accuracy: Item position effects on performance in university exams

Leonardo Jaya Vida, Matthieu J. S. Brinkhuis, Maria Bolsinova

Research output: Chapter in Book/Report/Conference proceedingChapterScientificpeer-review

46 Downloads (Pure)

Abstract

The quality of exams drives test-taking behavior of examinees and is a proxy for the quality of teaching. As most university exams have strict time limits, and speededness is an important measure of the cognitive state of examinees, this might be used to assess the connection between exams’ quality and examinees’ performance. The practice of randomization within university exams enables the analysis of item position effects within individual exams as a measure of speededness, and as such it enables the creation of a measure of the quality of an exam. In this research, we use generalized linear mixed models to evaluate item position effects on response accuracy and response time in a large dataset of randomized exams from an international research university. We find that there is an effect of item position on response time for most exams, but the same is not valid for response accuracy, which might be a starting point for identifying factors that influence speededness and can affect the mental state of examinees.
Original languageEnglish
Title of host publicationProceedings of the 14th International Conference on Educational Data Mining
Publication statusPublished - Jun 2021

Fingerprint

Dive into the research topics of 'Speeding up without loss of accuracy: Item position effects on performance in university exams'. Together they form a unique fingerprint.

Cite this