TY - JOUR
T1 - Know Your Game, From in-Real Life Experts to Video Game Experts
T2 - Discriminating in-Real Life Experts From Non-Experts Using Blinks and EAR-Derived Features
AU - Guglielmo, Gianluca
AU - Klincewicz, Michal
AU - Huis In 'T Veld, Elisabeth
AU - Spronck, Pieter
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2024
Y1 - 2024
N2 - Serious games are an effective method of reproducing aspects of the complex interplay between environments and stakeholders in business situations. In the game we describe here, The Sustainable Port, players experience what it is like to make decisions in such a complex environment. Their aim in the game is to grow the Port of Rotterdam while keeping economic growth in balance with sustainability goals. In this study, we assessed whether experienced Port of Rotterdam employees (PoR employees) show different psychophysiological patterns, and more specifically EAR-derived features, compared to students. We did this on the assumption that physiological patterns will tell us something about how people who are familiar with the environment of the Port of Rotterdam, more specifically Port of Rotterdam employees, make decisions compared to those lacking such familiarity.Our sample consisted of 28 PoR employees and 65 students, all of whom played The Sustainable Port game and had their faces recorded with a camera. The Eye Aspect Ratio was extracted from these recordings and then from those we extracted EAR-derived features. Our results show that Port of Rotterdam employees perform better than students and that the two groups are characterized by different physiological variations in their EAR-derived features. A logistic regression model used to identify PoR employees and students obtained an F1 score of 0.62, a PR AUC score of 0.64, and a ROC AUC score of 0.70. performing significantly above baseline suggesting the effectiveness of using EAR-derived features for this task. Our interpretation was further confirmed by a pseudo-R2 score used to evaluate the goodness of fit of a logistic regression model on the entire dataset. We found that Port of Rotterdam employees had a lower variation in blink rate per minute (blinks/m) and higher variation in the root mean square difference of successive difference in blinks (RMSSD), the consecutive difference between two continuous blinks. Moreover, this study shows that our methods were robust enough to negate the effects of confounders, such as biological sex and age that affect some other studies that analyze blinks.
AB - Serious games are an effective method of reproducing aspects of the complex interplay between environments and stakeholders in business situations. In the game we describe here, The Sustainable Port, players experience what it is like to make decisions in such a complex environment. Their aim in the game is to grow the Port of Rotterdam while keeping economic growth in balance with sustainability goals. In this study, we assessed whether experienced Port of Rotterdam employees (PoR employees) show different psychophysiological patterns, and more specifically EAR-derived features, compared to students. We did this on the assumption that physiological patterns will tell us something about how people who are familiar with the environment of the Port of Rotterdam, more specifically Port of Rotterdam employees, make decisions compared to those lacking such familiarity.Our sample consisted of 28 PoR employees and 65 students, all of whom played The Sustainable Port game and had their faces recorded with a camera. The Eye Aspect Ratio was extracted from these recordings and then from those we extracted EAR-derived features. Our results show that Port of Rotterdam employees perform better than students and that the two groups are characterized by different physiological variations in their EAR-derived features. A logistic regression model used to identify PoR employees and students obtained an F1 score of 0.62, a PR AUC score of 0.64, and a ROC AUC score of 0.70. performing significantly above baseline suggesting the effectiveness of using EAR-derived features for this task. Our interpretation was further confirmed by a pseudo-R2 score used to evaluate the goodness of fit of a logistic regression model on the entire dataset. We found that Port of Rotterdam employees had a lower variation in blink rate per minute (blinks/m) and higher variation in the root mean square difference of successive difference in blinks (RMSSD), the consecutive difference between two continuous blinks. Moreover, this study shows that our methods were robust enough to negate the effects of confounders, such as biological sex and age that affect some other studies that analyze blinks.
KW - Blinks
KW - expertise
KW - machine learning
KW - maritime port
KW - serious games
KW - sustainability
UR - http://www.scopus.com/inward/record.url?scp=85209990256&partnerID=8YFLogxK
U2 - 10.1109/TG.2024.3494724
DO - 10.1109/TG.2024.3494724
M3 - Article
AN - SCOPUS:85209990256
SN - 2475-1502
JO - IEEE Transactions on Games
JF - IEEE Transactions on Games
ER -