Rapid composition for networked devices: Happybrackets

Fraietta, A; Bown, O; Ferguson, S; Gillespie, S; Bray, L

Rapid composition for networked devices: Happybrackets

Fraietta, A Bown, O Ferguson, S

Gillespie, S Bray, L

Permalink

Publisher:: MIT Press - Journals
Publication Type:: Journal Article
Citation:: Computer Music Journal, 2020, 43, (2-3), pp. 89-108
Issue Date:: 2020-06-01

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

Adobe PDF

Download Published VersionAdobe PDF (866.59 kB)

View on publisher's site

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Fraietta, A
dc.contributor.author	Bown, O
dc.contributor.author	Ferguson, S https://orcid.org/0000-0003-1853-3000
dc.contributor.author	Gillespie, S
dc.contributor.author	Bray, L
dc.date.accessioned	2021-03-23T04:22:59Z
dc.date.available	2021-03-23T04:22:59Z
dc.date.issued	2020-06-01
dc.identifier.citation	Computer Music Journal, 2020, 43, (2-3), pp. 89-108
dc.identifier.issn	0148-9267
dc.identifier.issn	1531-5169
dc.identifier.uri	http://hdl.handle.net/10453/147478
dc.description.abstract	© 2020 Massachusetts Institute of Technology. This article introduces an open-source Java-based programming environment for creative coding ofagglomerative systems using Internet-of-Things (IoT) technologies. Our software originally focused on digital signalprocessing of audio—including synthesis, sampling, granular sample playback, and a suite of basic effects—butcomposers now use it to interface with sensors and peripherals through general-purpose input/output and externalnetworked systems. This article examines and addresses the strategies required to integrate novel embedded musicalinterfaces and creative coding paradigms through an IoT infrastructure. These include: The use of advanced toolingfeatures of a professional integrated development environment as a composition or performance interface rather thanjust as a compiler; techniques to create media works using features such as autodetection of sensors; seamless andserverless communication among devices on the network; and uploading, updating, and running of new compositionsto the device without interruption.Furthermore, we examined the difficulties many novice programmers experience when learning to write code,and we developed strategies to address these difficulties without restricting the potential available in the codingenvironment. We also examined and developed methods to monitor and debug devices over the network, allowingartists and programmers to set and retrieve current variable values to or from these devices during the performanceand composition stages. Finally, we describe three types of art work that demonstrate how the software, calledHappyBrackets, is being used in live-coding and dance performances, in interactive sound installations, and as anadvanced composition and performance tool for multimedia works.
dc.language	en
dc.publisher	MIT Press - Journals
dc.relation.ispartof	Computer Music Journal
dc.relation.isbasedon	10.1162/COMJ_a_00520
dc.rights	info:eu-repo/semantics/openAccess
dc.subject	1702 Cognitive Sciences, 1902 Film, Television and Digital Media, 1904 Performing Arts and Creative Writing
dc.subject.classification	Music
dc.title	Rapid composition for networked devices: Happybrackets
dc.type	Journal Article
utslib.citation.volume	43
utslib.for	1702 Cognitive Sciences
utslib.for	1902 Film, Television and Digital Media
utslib.for	1904 Performing Arts and Creative Writing
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology
pubs.organisational-group	/University of Technology Sydney/Strength - HCTD - Human Centred Technology Design
pubs.organisational-group	/University of Technology Sydney/Faculty of Engineering and Information Technology/School of Computer Science
utslib.copyright.status	open_access	*
pubs.consider-herdc	false
dc.date.updated	2021-03-23T04:22:58Z
pubs.issue	2-3
pubs.publication-status	Published
pubs.volume	43
utslib.citation.issue	2-3

Abstract:

© 2020 Massachusetts Institute of Technology. This article introduces an open-source Java-based programming environment for creative coding ofagglomerative systems using Internet-of-Things (IoT) technologies. Our software originally focused on digital signalprocessing of audio—including synthesis, sampling, granular sample playback, and a suite of basic effects—butcomposers now use it to interface with sensors and peripherals through general-purpose input/output and externalnetworked systems. This article examines and addresses the strategies required to integrate novel embedded musicalinterfaces and creative coding paradigms through an IoT infrastructure. These include: The use of advanced toolingfeatures of a professional integrated development environment as a composition or performance interface rather thanjust as a compiler; techniques to create media works using features such as autodetection of sensors; seamless andserverless communication among devices on the network; and uploading, updating, and running of new compositionsto the device without interruption.Furthermore, we examined the difficulties many novice programmers experience when learning to write code,and we developed strategies to address these difficulties without restricting the potential available in the codingenvironment. We also examined and developed methods to monitor and debug devices over the network, allowingartists and programmers to set and retrieve current variable values to or from these devices during the performanceand composition stages. Finally, we describe three types of art work that demonstrate how the software, calledHappyBrackets, is being used in live-coding and dance performances, in interactive sound installations, and as anadvanced composition and performance tool for multimedia works.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/147478