OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality

Ifigeneia Mavridou; James Archer William Archer; Andrew Cleal; Mohsen Fatoorechi; Simon Stankoski; Ivana Kiprijanovska; John Broulidakis; Martin Gjoreski; Charles Nduka; Hristijan Gjoreski

doi:10.1145/3544793.3560325

OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality

Ifigeneia Mavridou, James Archer William Archer, Andrew Cleal, Mohsen Fatoorechi, Simon Stankoski, Ivana Kiprijanovska, John Broulidakis, Martin Gjoreski, Charles Nduka, Hristijan Gjoreski

Research output: Contribution to conference › Paper › Scientific › peer-review

Abstract

The paper presents the novel OCOSenseTM smart glasses with integrated sensors, primarily non-contact optomyographic (OMG)
OCOTM sensors, 9-axis inertial measurement unit (IMU), and an altimeter. The glasses connect with a smartphone application, which facilitates the continuous and real-time measurements of facialmuscles activation and head movement, thus allowing for the detection of facial expressions and the activities of the user in real-time.
We will demonstrate how the system is used in practice, i.e., a participant will wear the OCOSenseTM glasses, which will stream the sensor data to a tablet, where the real-time visualization of the sensor data and the data interpretation will be presented such as facial expressions (smile, frown, surprise) and activities. We believe that the OCOSenseTM glasses are the next big thing in wearables,
which will allow for better understanding of the user’s context,
activities, emotional state, and more, which can be easily coupled
within Augmented and Extended Reality environments.

Original language	Undefined/Unknown
Pages	81-84
Number of pages	4
DOIs	https://doi.org/10.1145/3544793.3560325
Publication status	Published - Apr 2023
Externally published	Yes
Event	The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing - Cambridge, United Kingdom Duration: 11 Sept 2022 → 15 Sept 2022

Conference

Conference	The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing
Abbreviated title	UbiComp/ISWC '22
Country/Territory	United Kingdom
City	Cambridge
Period	11/09/22 → 15/09/22

Keywords

Machine learning
Sensors and actuators
Ubiquitous and mobile computing

Access to Document

10.1145/3544793.3560325

Cite this

Mavridou, I., Archer, J. A. W., Cleal, A., Fatoorechi, M., Stankoski, S., Kiprijanovska, I., Broulidakis, J., Gjoreski, M., Nduka, C., & Gjoreski, H. (2023). OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality. 81-84. Paper presented at The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Cambridge, United Kingdom. https://doi.org/10.1145/3544793.3560325

@conference{707a7e8ef84d4a3286866776a90bd7a5,

title = "OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality",

abstract = "The paper presents the novel OCOSenseTM smart glasses with integrated sensors, primarily non-contact optomyographic (OMG)OCOTM sensors, 9-axis inertial measurement unit (IMU), and an altimeter. The glasses connect with a smartphone application, which facilitates the continuous and real-time measurements of facialmuscles activation and head movement, thus allowing for the detection of facial expressions and the activities of the user in real-time.We will demonstrate how the system is used in practice, i.e., a participant will wear the OCOSenseTM glasses, which will stream the sensor data to a tablet, where the real-time visualization of the sensor data and the data interpretation will be presented such as facial expressions (smile, frown, surprise) and activities. We believe that the OCOSenseTM glasses are the next big thing in wearables,which will allow for better understanding of the user{\textquoteright}s context,activities, emotional state, and more, which can be easily coupledwithin Augmented and Extended Reality environments.",

keywords = "Machine learning, Sensors and actuators, Ubiquitous and mobile computing",

author = "Ifigeneia Mavridou and Archer, {James Archer William} and Andrew Cleal and Mohsen Fatoorechi and Simon Stankoski and Ivana Kiprijanovska and John Broulidakis and Martin Gjoreski and Charles Nduka and Hristijan Gjoreski",

year = "2023",

month = apr,

doi = "10.1145/3544793.3560325",

language = "Undefined/Unknown",

pages = "81--84",

note = "The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing ; Conference date: 11-09-2022 Through 15-09-2022",

}

Mavridou, I, Archer, JAW, Cleal, A, Fatoorechi, M, Stankoski, S, Kiprijanovska, I, Broulidakis, J, Gjoreski, M, Nduka, C & Gjoreski, H 2023, 'OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality', Paper presented at The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Cambridge, United Kingdom, 11/09/22 - 15/09/22 pp. 81-84. https://doi.org/10.1145/3544793.3560325

OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality. / Mavridou, Ifigeneia; Archer, James Archer William; Cleal, Andrew et al.
2023. 81-84 Paper presented at The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Cambridge, United Kingdom.

Research output: Contribution to conference › Paper › Scientific › peer-review

TY - CONF

T1 - OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality

AU - Mavridou, Ifigeneia

AU - Archer, James Archer William

AU - Cleal, Andrew

AU - Fatoorechi, Mohsen

AU - Stankoski, Simon

AU - Kiprijanovska, Ivana

AU - Broulidakis, John

AU - Gjoreski, Martin

AU - Nduka, Charles

AU - Gjoreski, Hristijan

PY - 2023/4

Y1 - 2023/4

N2 - The paper presents the novel OCOSenseTM smart glasses with integrated sensors, primarily non-contact optomyographic (OMG)OCOTM sensors, 9-axis inertial measurement unit (IMU), and an altimeter. The glasses connect with a smartphone application, which facilitates the continuous and real-time measurements of facialmuscles activation and head movement, thus allowing for the detection of facial expressions and the activities of the user in real-time.We will demonstrate how the system is used in practice, i.e., a participant will wear the OCOSenseTM glasses, which will stream the sensor data to a tablet, where the real-time visualization of the sensor data and the data interpretation will be presented such as facial expressions (smile, frown, surprise) and activities. We believe that the OCOSenseTM glasses are the next big thing in wearables,which will allow for better understanding of the user’s context,activities, emotional state, and more, which can be easily coupledwithin Augmented and Extended Reality environments.

AB - The paper presents the novel OCOSenseTM smart glasses with integrated sensors, primarily non-contact optomyographic (OMG)OCOTM sensors, 9-axis inertial measurement unit (IMU), and an altimeter. The glasses connect with a smartphone application, which facilitates the continuous and real-time measurements of facialmuscles activation and head movement, thus allowing for the detection of facial expressions and the activities of the user in real-time.We will demonstrate how the system is used in practice, i.e., a participant will wear the OCOSenseTM glasses, which will stream the sensor data to a tablet, where the real-time visualization of the sensor data and the data interpretation will be presented such as facial expressions (smile, frown, surprise) and activities. We believe that the OCOSenseTM glasses are the next big thing in wearables,which will allow for better understanding of the user’s context,activities, emotional state, and more, which can be easily coupledwithin Augmented and Extended Reality environments.

KW - Machine learning

KW - Sensors and actuators

KW - Ubiquitous and mobile computing

U2 - 10.1145/3544793.3560325

DO - 10.1145/3544793.3560325

M3 - Paper

SP - 81

EP - 84

T2 - The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Y2 - 11 September 2022 through 15 September 2022

ER -

Mavridou I, Archer JAW, Cleal A, Fatoorechi M, Stankoski S, Kiprijanovska I et al.. OCOsense Glasses for Facial Expressions Recognition and Contextual Affective Computing in Real World and Augmented Reality. 2023. Paper presented at The 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Cambridge, United Kingdom. doi: 10.1145/3544793.3560325