TY - GEN
T1 - Gamified assessment of collaborative skills with chatbots
AU - Stoeffler, Kristin
AU - Rosen, Yigal
AU - Bolsinova, Maria
AU - von Davier, Alina A.
N1 - Publisher Copyright:
© Springer International Publishing AG, part of Springer Nature 2018.
PY - 2018
Y1 - 2018
N2 - Game-based assessments and learning environments create unique opportunities to provide learners with the ability to demonstrate their proficiency with cognitive skills and behaviors in increasingly authentic environments. Effective task designs, and the effective alignment of tasks with constructs, are also improving our ability to provide learners with insights about their proficiency with these skills. Sharing these insights within the industry with those working toward the same goal contributes to the rising tide that lifts all boats. In this paper we present insights from our work to develop and measure collaborative problem solving skills using a game-based assessment “Circuit Runner.” Our innovative educational game design allows us to incorporate item response data, telemetry data, and stealth- telemetry data to provide a more authentic measure of collaborative problem solving skills. Our study design included 379 study participants on Amazon Mechanical Turk (MTurk), who completed the “Circuit Runner” CPS assessment. The paper provides details on the design of educational games and scoring techniques and discusses findings from the pilot study.
AB - Game-based assessments and learning environments create unique opportunities to provide learners with the ability to demonstrate their proficiency with cognitive skills and behaviors in increasingly authentic environments. Effective task designs, and the effective alignment of tasks with constructs, are also improving our ability to provide learners with insights about their proficiency with these skills. Sharing these insights within the industry with those working toward the same goal contributes to the rising tide that lifts all boats. In this paper we present insights from our work to develop and measure collaborative problem solving skills using a game-based assessment “Circuit Runner.” Our innovative educational game design allows us to incorporate item response data, telemetry data, and stealth- telemetry data to provide a more authentic measure of collaborative problem solving skills. Our study design included 379 study participants on Amazon Mechanical Turk (MTurk), who completed the “Circuit Runner” CPS assessment. The paper provides details on the design of educational games and scoring techniques and discusses findings from the pilot study.
KW - Assessment
KW - Game
KW - Stealth
UR - http://www.scopus.com/inward/record.url?scp=85049369661&partnerID=8YFLogxK
U2 - 10.1007/978-3-319-93846-2_64
DO - 10.1007/978-3-319-93846-2_64
M3 - Conference contribution
AN - SCOPUS:85049369661
SN - 9783319938455
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 343
EP - 347
BT - Artificial Intelligence in Education - 19th International Conference, AIED 2018, Proceedings
A2 - Luckin, Rose
A2 - Porayska-Pomsta, Kaska
A2 - du Boulay, Benedict
A2 - Mavrikis, Manolis
A2 - Penstein Rosé, Carolyn
A2 - McLaren, Bruce
A2 - Martinez-Maldonado, Roberto
A2 - Hoppe, H. Ulrich
PB - Springer Verlag
T2 - 19th International Conference on Artificial Intelligence in Education, AIED 2018
Y2 - 27 June 2018 through 30 June 2018
ER -