The limitations of representing sound and notation on screen
Document Type
Journal Article
Publisher
Cambridge University Press
School
Western Australian Academy of Performing Arts (WAAPA) / Music Research Group
RAS ID
18491
Abstract
Animated screen-based notation and visual representation of sound provide an important solution to visualising a range of musical phenomena and techniques including continuous parametrical changes, synchronisation with prerecorded audio or live processing, and nonlinear formal organisation. The limitations of human visual capabilities, however, place some constraints upon the efficacy of screen-based representation, particularly in regard to notation reading. Findings from sightreading studies exploring the manner in which notation is encoded, processed and executed are examined with the aim of identifying the perceptual and practical boundaries of presenting animated notation on screen. The development of efficient visual representation is proposed as an important requirement for alleviating the issues created by the time constraints of reading on screen. Studies in semantics and cross-modal activation are discussed as a foundation for the expansion of approaches to the visualisation of sound.
DOI
10.1017/S1355771814000193
Access Rights
subscription content
Comments
Vickery, L. (2014). The Limitations of Representing Sound and Notation on Screen. Organised Sound, 19(3), 215-227. Available here.