Using Sensors and Facial Expression Recognition to Personalize Emotions Learning for Autistic Children

Abstract

This paper describes CaptureMyEmotion, an app for smartphones adn tablets which uses wireless sensors to capture physiological data together with facial expressions recognitition to provide a very personalized way to help autistic children and their career, but none of the existing apps users the full potential offered by mobile technology and sensors to overcome one of autistic children's main difficulty: the identificationand expressions of emotions. CaptureMyEmotion enable autistic children to capture photos, video or sounds, and identify the emotions they felt while taking the picture. Simultaneously, a self-portrait of the child is taken, and the app measures the arousal and stress levels using wireless sensors. The app uses the self portrait to provide a better estimate of the emotion felt byt the child. The app has the potential to help autistic children understand their emotions and it gives the career insight into the child;s emotions and offers a means to discuss the child's feelings.