Gesture-Controlled Interaction with Aesthetic Information Sonification

Creativity and Cognition Press
Publication Type:
Conference Proceeding
Proceedings of The Second Australasian Conference on Interactive Entertainment 2005, 2005, 1 pp. 11 - 18
Issue Date:
Full metadata record
Files in This Item:
Filename Description Size
Thumbnail2009004064.pdf595.9 kB
Adobe PDF
Information representation in augmented and virtual reality systems, and social physical (building) spaces can enhance the efficacy of interacting with and assimilating abstract, non-visual data. Sanification is the process of automatically generated real time information representation. There is a gap in our implementation and knowledge of auditory display systems used to enhance interaction in virtual and augmented reality. This paper addresses that gap by examining methodologies for mapping socio-spatial data to spatialised sanification manipulated with gestural controllers. This is a system of interactive knowledge representation that completes the human integration loop, enabling the user to interact with and manipulate data using 3D spatial gesture and 3D auditory display. Benefits include 1) added immersion in an augmented or virtual reality interface; 2) auditory display avoids visual overload in visually-saturated processes such as designing, evacuation in emergencies, flying aircraft; computer gaming; and 3) bi-modal or auditory representation, due to its time-based character, facilitates cognition of complex information.
Please use this identifier to cite or link to this item: