Using sensors and facial expression recognition to personalize emotion learning for autistic children

Gay, V; Leijdekkers, P; Wong, F

Using sensors and facial expression recognition to personalize emotion learning for autistic children

Gay, V

Leijdekkers, P

Wong, F

Permalink

Publication Type:: Conference Proceeding
Citation:: Studies in Health Technology and Informatics, 2013, 189 pp. 71 - 76
Issue Date:: 2013-01-01

Closed Access

	Filename	Description	Size
	2012008274OK.pdf	Published version	2.93 MB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Gay, V https://orcid.org/0000-0002-4301-1995	en_US
dc.contributor.author	Leijdekkers, P https://orcid.org/0000-0003-3579-1175	en_US
dc.contributor.author	Wong, F	en_US
dc.date.issued	2013-01-01	en_US
dc.identifier.citation	Studies in Health Technology and Informatics, 2013, 189 pp. 71 - 76	en_US
dc.identifier.isbn	9781614992677	en_US
dc.identifier.issn	0926-9630	en_US
dc.identifier.uri	http://hdl.handle.net/10453/32403
dc.description.abstract	This paper describes CaptureMyEmotion, an app for smartphones and tablets which uses wireless sensors to capture physiological data together with facial expression recognition to provide a very personalized way to help autistic children identify and understand their emotions. Many apps are targeting autistic children and their carer, but none of the existing apps uses the full potential offered by mobile technology and sensors to overcome one of autistic children's main difficulty: the identification and expression of emotions. CaptureMyEmotion enables autistic children to capture photos, videos or sounds, and identify the emotion they felt while taking the picture. Simultaneously, a self-portrait of the child is taken, and the app measures the arousal and stress levels using wireless sensors. The app uses the self-portrait to provide a better estimate of the emotion felt by the child. The app has the potential to help autistic children understand their emotions and it gives the carer insight into the child's emotions and offers a means to discuss the child's feelings. © 2013 The authors and IOS Press. All rights reserved.	en_US
dc.relation.ispartof	Studies in Health Technology and Informatics	en_US
dc.relation.isbasedon	10.3233/978-1-61499-268-4-71	en_US
dc.subject.classification	Medical Informatics	en_US
dc.subject.mesh	Humans	en_US
dc.subject.mesh	Monitoring, Ambulatory	en_US
dc.subject.mesh	Facial Expression	en_US
dc.subject.mesh	Therapy, Computer-Assisted	en_US
dc.subject.mesh	Equipment Design	en_US
dc.subject.mesh	Expressed Emotion	en_US
dc.subject.mesh	Autistic Disorder	en_US
dc.subject.mesh	Computers, Handheld	en_US
dc.subject.mesh	Software	en_US
dc.subject.mesh	Child	en_US
dc.subject.mesh	Biofeedback, Psychology	en_US
dc.subject.mesh	Wireless Technology	en_US
dc.title	Using sensors and facial expression recognition to personalize emotion learning for autistic children	en_US
dc.type	Conference Proceeding
utslib.citation.volume	189	en_US
utslib.for	111714 Mental Health	en_US
utslib.for	090399 Biomedical Engineering not elsewhere classified	en_US
utslib.for	0807 Library and Information Studies	en_US
utslib.for	1117 Public Health and Health Services	en_US
pubs.embargo.period	Not known	en_US
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Computer Science
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Electrical and Data Engineering
pubs.organisational-group	/University of Technology Sydney/Strength - CHT - Health Technologies
pubs.organisational-group	/University of Technology Sydney/Strength - INEXT - Innovation in IT Services and Applications
utslib.copyright.status	closed_access
pubs.publication-status	Published	en_US
pubs.volume	189	en_US

Abstract:

This paper describes CaptureMyEmotion, an app for smartphones and tablets which uses wireless sensors to capture physiological data together with facial expression recognition to provide a very personalized way to help autistic children identify and understand their emotions. Many apps are targeting autistic children and their carer, but none of the existing apps uses the full potential offered by mobile technology and sensors to overcome one of autistic children's main difficulty: the identification and expression of emotions. CaptureMyEmotion enables autistic children to capture photos, videos or sounds, and identify the emotion they felt while taking the picture. Simultaneously, a self-portrait of the child is taken, and the app measures the arousal and stress levels using wireless sensors. The app uses the self-portrait to provide a better estimate of the emotion felt by the child. The app has the potential to help autistic children understand their emotions and it gives the carer insight into the child's emotions and offers a means to discuss the child's feelings. © 2013 The authors and IOS Press. All rights reserved.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/32403