Finding meaning in data: Using data elements to sonify and visualize the found environment
Western Australian Academy of Performing Arts (WAAPA)
Visiting a natural setting can be a deeply visceral experience. Experiencing a landscape is a two-part process: firstly, the senses take in information from a three-dimensional world – for most of us, these take the forms of sights and sounds. Secondly, this information is translated into a mental landscape flecked with the nuances of personal meaning. How one interprets a landscape cannot be separated from the observer; our personal experiences (and biases) filter and colour our observations. Arguably, the use of landscapes in the creation of artefacts is a form of communicative expression, both between the artist and the landscape, and between the artist and their own experiences. These considerations then raise the question of how an artist can then depict these visual and aural experiences, and the impact they have on the artist, as tangible artefacts that can be shared with others? One answer is through the creation of audio-visual works that combine the visual and aural aspects of a setting, and which then leads to another question: how do you create – or re-create – representations of a landscape? How does one establish relationships and associations between visual and aural information drawn from the found environment (that is, the environment in situ as seen and heard through the eyes and ears of an observer) and place these into audio-visual compositions? This article explores the creation of audiovisual representations of the found environment using elements of data as methods of sonification, the compositional processes involved with organising these data elements, using data as a structural process that informs the parameters of a composition and the use of music visualisation. Multiple data elements such as hexadecimal data, field footage, field recordings and contours of a landscape can be used to sonify the found environment by creating multiple perspectives of the environment into the work. It also strengthens the connection between the aural and the visual by creating links between both mediums. This article will discuss these points through analysis of the creation of ‘Civil Eyes // The Wild’, an audio-visual performance that was commissioned by the ‘You Are Here Festival’ in 2016— using the performance as an example of how the found environment can be used as parameters for sonification and visualisation.