Gestural Hyper Instrument Collaboration with Generative Computation for Real Time Creativity

Sheridan Printing
Publication Type:
Conference Proceeding
Creativity and Cognition Conference '07, 2007, 1 pp. 213 - 222
Issue Date:
Full metadata record
Files in This Item:
Filename Description Size
Thumbnail2009003977OK.pdf3.95 MB
Adobe PDF
This paper describes the performance, mapping, transformation and representation phases of a model for gesturetriggered musical creativity. These phases are articulated in an example creative environment, Hyper-Shuku (BorderCrossing), an audio-visually augmented shakuhachi performance to demonstrate the adaptive, empathetic response of the generative systems. The shakuhachi is a Japanese traditional end-blown bamboo Zen flute. Its 5 holes and simple construction require subtle and complex gestural movements to produce its diverse range of pitches, vibrato and pitch inflections, making it an ideal candidate for gesture capture. The environment uses computer vision, gesture sensors and computer listening to process and generate electronic music and visualization in real time response to the live performer. The integration oflooming auditory motion and Neural Oscillator Network (NOSC) generative modules are implemented in this example.
Please use this identifier to cite or link to this item: