Sens-e-motion: Capturing and visualising emotional status of computer users in real time

Huang, W; Jayaraman, PP; Morshed, A; Blackburn, S; Redpath, C; Guerney, T; Shahid, AH; Mui, R

Sens-e-motion: Capturing and visualising emotional status of computer users in real time

Huang, W

Jayaraman, PP Morshed, A Blackburn, S Redpath, C Guerney, T Shahid, AH Mui, R

Permalink

Publisher:: IEEE
Publication Type:: Conference Proceeding
Citation:: Proceedings - 2019 23rd International Conference in Information Visualization - Part II, IV-2 2019, 2019, pp. 96-99
Issue Date:: 2019-07-01

Closed Access

	Filename	Description	Size
	08812000.pdf	Published version	138.17 kB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Huang, W https://orcid.org/0000-0002-5190-7839
dc.contributor.author	Jayaraman, PP
dc.contributor.author	Morshed, A
dc.contributor.author	Blackburn, S
dc.contributor.author	Redpath, C
dc.contributor.author	Guerney, T
dc.contributor.author	Shahid, AH
dc.contributor.author	Mui, R
dc.date	2019-07-16
dc.date.accessioned	2020-05-29T22:35:49Z
dc.date.available	2020-05-29T22:35:49Z
dc.date.issued	2019-07-01
dc.identifier.citation	Proceedings - 2019 23rd International Conference in Information Visualization - Part II, IV-2 2019, 2019, pp. 96-99
dc.identifier.isbn	9781728128504
dc.identifier.uri	http://hdl.handle.net/10453/140999
dc.description.abstract	© 2019 IEEE. Emotion has been demonstrated to play an important role in the learning process. The capturing of these emotions is increasingly being digitally automated as researchers explore how technology can enhance student learning as well as teaching methodologies. More specifically, what emotions should be captured and how information about the captured emotions should be visualised has not been well researched in the context of teaching and learning. The study presented in this paper aims to produce a proof of concept prototype, called Sens-e-motion, that integrates multiple types of digital emotional monitoring and visualises the results in a meaningful way to the users. The monitoring includes facial expression recognition, blink-rate, text sentiment analysis, and keyword analysis. The prototype was designed and implemented as a web chat application with a RESTful web service backend and a NoSQL database. In this paper, we present the design of our system and describe technical details of it. Possible future research and development is also discussed.
dc.language	en
dc.publisher	IEEE
dc.relation.ispartof	Proceedings - 2019 23rd International Conference in Information Visualization - Part II, IV-2 2019
dc.relation.ispartof	International Conference in Information Visualization – Part II
dc.relation.isbasedon	10.1109/IV-2.2019.00028
dc.rights	© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.	en_US
dc.rights	info:eu-repo/semantics/closedAccess
dc.title	Sens-e-motion: Capturing and visualising emotional status of computer users in real time
dc.type	Conference Proceeding
utslib.location.activity	Adelaide, Australia
pubs.organisational-group	/University of Technology Sydney/Faculty of Transdisciplinary Innovation
pubs.organisational-group	/University of Technology Sydney
utslib.copyright.status	closed_access	*
pubs.consider-herdc	false
dc.date.updated	2020-05-29T22:35:45Z
pubs.finish-date	2019-07-19
pubs.place-of-publication	Piscataway, USA
pubs.publication-status	Published
pubs.start-date	2019-07-16
utslib.start-page	96
dc.location	Piscataway, USA

Abstract:

© 2019 IEEE. Emotion has been demonstrated to play an important role in the learning process. The capturing of these emotions is increasingly being digitally automated as researchers explore how technology can enhance student learning as well as teaching methodologies. More specifically, what emotions should be captured and how information about the captured emotions should be visualised has not been well researched in the context of teaching and learning. The study presented in this paper aims to produce a proof of concept prototype, called Sens-e-motion, that integrates multiple types of digital emotional monitoring and visualises the results in a meaningful way to the users. The monitoring includes facial expression recognition, blink-rate, text sentiment analysis, and keyword analysis. The prototype was designed and implemented as a web chat application with a RESTful web service backend and a NoSQL database. In this paper, we present the design of our system and describe technical details of it. Possible future research and development is also discussed.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/140999