Retrogaming as visual feedback for speech therapy

Tan, CT; Johnston, A; Bluff, A; Ferguson, S; Ballard, KJ

Retrogaming as visual feedback for speech therapy

Tan, CT Johnston, A

Bluff, A

Ferguson, S

Ballard, KJ

Permalink

Publication Type:: Conference Proceeding
Citation:: SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications, SA 2014, 2014
Issue Date:: 2014-01-01

Closed Access

	Filename	Description	Size
	a4-tan.pdf	Published version	624.34 kB	Adobe PDF	View/Open

Copyright Clearance Process

Recently Added
In Progress
Closed Access

This item is closed access and not available.

Full metadata record

Field	Value	Language
dc.contributor.author	Tan, CT	en_US
dc.contributor.author	Johnston, A https://orcid.org/0000-0001-8306-7507	en_US
dc.contributor.author	Bluff, A https://orcid.org/0000-0003-3215-279X	en_US
dc.contributor.author	Ferguson, S https://orcid.org/0000-0003-1853-3000	en_US
dc.contributor.author	Ballard, KJ	en_US
dc.date.issued	2014-01-01	en_US
dc.identifier.citation	SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications, SA 2014, 2014	en_US
dc.identifier.isbn	9781450318914	en_US
dc.identifier.uri	http://hdl.handle.net/10453/33540
dc.description.abstract	A key problem in speech therapy is the motivation of patients in repetitive vocalization tasks. One important task is the vocalization of vowels. We present a novel solution by incorporating formant speech analysis into retro games to enable intrinsic motivation in performing the vocalization tasks in a fun and accessible manner. The visuals in the retro games also provide a simple and instantaneous feedback mechanism to the patients' vocalization performance. We developed an accurate and efficient formant recognition system to continuously recognize vowel vocalizations in real time. We implemented the system into two games, Speech Invaders and Yak-man, published on the iOS App Store in order to perform an initial public trial. We present the development to inform like-minded researchers who wish to incorporate real-time speech recognition in serious games.	en_US
dc.relation.ispartof	SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications, SA 2014	en_US
dc.relation.isbasedon	10.1145/2669062.2669069	en_US
dc.title	Retrogaming as visual feedback for speech therapy	en_US
dc.type	Conference Proceeding
utslib.for	080602 Computer-Human Interaction	en_US
dc.location.activity	ACM
dc.location.activity	Shenzen Convention & Exhibition Center
pubs.embargo.period	Not known	en_US
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Computer Science
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Software
pubs.organisational-group	/University of Technology Sydney/Strength - HCTD - Human Centred Technology Design
utslib.copyright.status	closed_access
pubs.publication-status	Published	en_US

Abstract:

A key problem in speech therapy is the motivation of patients in repetitive vocalization tasks. One important task is the vocalization of vowels. We present a novel solution by incorporating formant speech analysis into retro games to enable intrinsic motivation in performing the vocalization tasks in a fun and accessible manner. The visuals in the retro games also provide a simple and instantaneous feedback mechanism to the patients' vocalization performance. We developed an accurate and efficient formant recognition system to continuously recognize vowel vocalizations in real time. We implemented the system into two games, Speech Invaders and Yak-man, published on the iOS App Store in order to perform an initial public trial. We present the development to inform like-minded researchers who wish to incorporate real-time speech recognition in serious games.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/33540