"SkylAR"
Contrary to the net-art projects related to "Why Frets?" that should be accessed with a desktop or laptop computer, "SkylAR" comprises five augmented reality (AR) projects to be accessed with mobile devices. Each of them is based on texts, which are triggered by user actions. While various forms of interaction are used in these projects, they are all based on point&trigger actions, largely compareable to those investigated in "Why Frets? - FLOAT". What formed the special focus for the investigation of liveness in these AR projects were two things: the use of voices, and the very principle of AR, namely the integration of virtual objects in a physical environment.
Use of Augmented Reality
The Augmented Reality (AR) in SkylAR is image-based, which means that a mobile device has to be pointed at a particular image - in this case posters - that are starting the AR functionality.Contrary to designing virtual spaces that costitute a self-sufficent reality, AR usually does not create the same kind of separation between the virtual and the physical world, as AR makes object appear on top of the image of the physical world, rather than covering it completely.
SkylAR has been developed to be used with posters that are distributed in public space. In such circumstances, the most likely medium to access the AR would be someone's mobile phone. What makes mobile phones different from most other technological devices is that they are very personal items that contain a lot of personal information. In SkylAR the use of the mobile phone as an access device adds an intimate aspect when the artwork is accessed in public space. Also, the environment stays presend visually and sonically while exploring the work.
Use of voices
The texts that are triggered in the AR projects are not only visible, but also audible. Each of these projects uses voices with distinct qualities, using male and female voices with different degrees of processing, or synthetic voices. Also different techniques for voice production have been used such as speaking text backwards and reversing the recordings, or speaking while inhaling air, instead of exhaling it.
What is investigated in this case is how voices can generate a form of liveness in a context that can be categorized as Paul Sanden's "virtual liveness". According to Sanden, "virtual liveness invokes virtual performing personae: performers who exist only in a listener’s encounter with highly mediatized music” (Sanden 2013: 128) He also refers to the virtual personae as sounding cyborgs: “in highly mediatized musical contexts, perception of liveness may extend beyond what a “real” performer has presented for the audience, and the performer may find him or herself sharing the stage with, or even relinquishing it entirely to, an imagined and technologically enhanced performing persona.” (Sanden 2013: 129)
The construction of virtual personae is an aspect that is also present visually, as all SkylAR projects work with images of hero-figures from comics from the 50s. All texts are then also displayed in typical speech-bubbles and then accompanied with the preproduced vocal performances. The goal has thus been to construct a virtual persona that the user identifies with, in other words: an emotional bond is established with the virtual character that is supported by the feelings of liveness. While Sanden discusses virtual personae only in reference to recorded music, here the argument is that the interactive quality of the work, which literally brings the virtual being into existence by the user's actions, significantly intensifies the experience of liveness and the connection with the virtual phenomena.
The following links leads to the individual SkylAR AR-projects. They are not discussed in detail. The used text is displayed with a description of the use of voice. Furthermore a documentation of the work is presented and it is possible to access the work directly.