Sound Image, Text and Culture: The Interplay of Computation, Communication and Body

Publication Type:
Conference Proceeding
Image, Text and Sound: The Yet Unseen: Rendering Stories, 2004, pp. 1 - 7
Issue Date:
Filename Description Size
Thumbnail2004001972.pdf491 kB
Adobe PDF
Full metadata record
Intuition is the instantaneous knowledge that we possess of what is present in a perceived environment, which includes the possible intentions of others. In human to human interaction, we intuitively respond to each other's desires and moods by reading 'body language', that is, we are responding to gestures. There has been considerable work done in recent years by technologists on the possibilities of computer recognition of this language, the principle being, that a machine could respond to human emotions rather than intellectual states. Semiotics, the science of signs and symbols, offers a precise grammar by which gestures can be interpreted; the core elements are metaphor, metonymy and utterance, which is the expression and interpretation of images in a sequential narrative structure. Significantly, the same analytical tools can be applied to components of computer interfaces, namely sound, image and text. What results is a set of distinctions and parallels between gestural body language and multimedia, which establishes design principles for information artists. This paper will examine the effects of computation on human communication as a historical process of technical innovation which reconfigures sound, image, text and gesture, central to the human experience of communication. Yoga, a gestural system which raises intuitive awareness, is the focus of the movement analysis.
Please use this identifier to cite or link to this item: