Towards personalised gaming via facial expression recognition

Publication Type:
Conference Proceeding
Proceedings of the 10th AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, AIIDE 2014, 2014, pp. 30 - 36
Issue Date:
Full metadata record
Copyright © 2014, Association for the Advancement of Artificial Intelligence ( All rights reserved. In this paper we propose an approach for personalising the space in which a game is played (i.e., levels) dependent on classifications of the user's facial expression - to the end of tailoring the affective game experience to the individual user. Our approach is aimed at online game personalisation, i.e., the game experience is personalised during actual play of the game. A key insight of this paper is that game personalisation techniques can leverage novel computer vision-based techniques to unobtrusively infer player experiences automatically based on facial expression analysis. Specifically, to the end of tailoring the affective game experience to the individual user, in this paper we (1) leverage the proven INSIGHT facial expression recognition SDK as a model of the user's affective state (Sightcorp 2014), and (2) employ this model for guiding the online game personalisation process. User studies that validate the game personalisation approach in the actual video game INFINITE MARIO BROS. reveal that it provides an effective basis for converging to an appropriate affective state for the individual human player.
Please use this identifier to cite or link to this item: