The Assessment of Spontaneous Emotional Expressions from the Frontal and Profile Facial Orientations

Sidavong, Lina

The Assessment of Spontaneous Emotional Expressions from the Frontal and Profile Facial Orientations

Sidavong, Lina

Permalink

Publication Type:: Thesis
Issue Date:: 2023

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

Adobe PDF

Download thesisAdobe PDF (6.29 MB)

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Sidavong, Lina
dc.date.accessioned	2023-07-14T00:49:14Z
dc.date.available	2023-07-14T00:49:14Z
dc.date.issued	2023
dc.identifier.uri	http://hdl.handle.net/10453/171491
dc.description	University of Technology Sydney. Faculty of Science.	en_US.UTF-8
dc.description.abstract	The present study attempted to induce spontaneous emotions in individuals to determine whether specific pattern changes in facial movement could be determined from the frontal and profile views. A total of 142 volunteers (males = 50, and females = 92) aged between 18 to 34 years were presented with a series of short videos to induce one of three emotions: amusement, sadness, and fear. Their facial behaviours were recorded from three different facial positions (left, right, and frontal views) along with their physiological skin conductance response. After the viewing of each short film, each subject completed a self-report questionnaire to indicate what emotions they felt during certain scenes of the film. Self-reports revealed that discrete emotions of amusement and sadness were experienced in 79.58% and 83.8% of participants compared to discrete fear which was elicited in only 50% of participants. Skin conductance responses from electrodermal activity (EDA) readings were observed during the expressions of amusement and fear whilst a mixed response pattern was seen for sadness. These skin conductance responses to sadness were marked by a reduction in tonic EDA, seen as either the presence or absence of skin conductance. As such, it was relatively difficult (particularly for sadness) to precisely reflect emotional changes by using a single physiological signal. When it came to the behavioural level of expression, subjects displayed a variety of action units (AUs) that produced similar appearance changes that were uniquely associated with an emotion. The Lucas-Kanade optical flow and facial landmark feature extraction techniques were implemented to quantify the facial changes that occurred between onset (baseline) and peak of emotional expression. Classification using feature vectors indicated that landmark extraction method outperformed optical flow analysis achieving predictive accuracy recognitions of 71-75%, 70-72% and 70-71% compared to 49-64%, 60-68% and 64-68% in optical flow for the frontal, profile left and right facial views, respectively. Where amusement was consistently classified across all views, sadness and fear were classified best from the left and right profile views, respectively. Thus, spontaneous emotional facial expressions are uniquely expressed and shows discrimination potential from the frontal, profile left and right facial views. This research indicates relevance for real world applications such as in security surveillance to enhance detection of signs of emotion, associated with behaviours intent in causing harm. In particular where facial orientation relative to the surveillance camera location and the face are not necessary in-plane with full frontal view.	en_US.UTF-8
dc.format	Thesis (PhD)
dc.language.iso	en_US	en_US.UTF-8
dc.relation	https://opus.lib.uts.edu.au/bitstream/10453/171491/1/thesis.pdf
dc.rights	info:eu-repo/semantics/openAccess
dc.rights	The author owns the copyright in this thesis including all reproduction and reuse rights for the work. The work may not be altered without the permission of the copyright owner. Attribution is essential when quoting or paraphrasing from this thesis.
dc.rights	© 2023 Lina Sidavong
dc.rights	au.edu.uts.lib/cph
dc.title	The Assessment of Spontaneous Emotional Expressions from the Frontal and Profile Facial Orientations	en_US.UTF-8
dc.type	Thesis
utslib.copyright.status	open_access	*

Abstract:

The present study attempted to induce spontaneous emotions in individuals to determine whether specific pattern changes in facial movement could be determined from the frontal and profile views. A total of 142 volunteers (males = 50, and females = 92) aged between 18 to 34 years were presented with a series of short videos to induce one of three emotions: amusement, sadness, and fear. Their facial behaviours were recorded from three different facial positions (left, right, and frontal views) along with their physiological skin conductance response. After the viewing of each short film, each subject completed a self-report questionnaire to indicate what emotions they felt during certain scenes of the film. Self-reports revealed that discrete emotions of amusement and sadness were experienced in 79.58% and 83.8% of participants compared to discrete fear which was elicited in only 50% of participants. Skin conductance responses from electrodermal activity (EDA) readings were observed during the expressions of amusement and fear whilst a mixed response pattern was seen for sadness. These skin conductance responses to sadness were marked by a reduction in tonic EDA, seen as either the presence or absence of skin conductance. As such, it was relatively difficult (particularly for sadness) to precisely reflect emotional changes by using a single physiological signal. When it came to the behavioural level of expression, subjects displayed a variety of action units (AUs) that produced similar appearance changes that were uniquely associated with an emotion. The Lucas-Kanade optical flow and facial landmark feature extraction techniques were implemented to quantify the facial changes that occurred between onset (baseline) and peak of emotional expression. Classification using feature vectors indicated that landmark extraction method outperformed optical flow analysis achieving predictive accuracy recognitions of 71-75%, 70-72% and 70-71% compared to 49-64%, 60-68% and 64-68% in optical flow for the frontal, profile left and right facial views, respectively. Where amusement was consistently classified across all views, sadness and fear were classified best from the left and right profile views, respectively. Thus, spontaneous emotional facial expressions are uniquely expressed and shows discrimination potential from the frontal, profile left and right facial views. This research indicates relevance for real world applications such as in security surveillance to enhance detection of signs of emotion, associated with behaviours intent in causing harm. In particular where facial orientation relative to the surveillance camera location and the face are not necessary in-plane with full frontal view.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/171491