The Sound of Being There: Audiovisual Cartography with Immersive Virtual Environments

In recent years, immersion has become a frequently emphasized factor in the geovisualization research agenda. A principal reason for this growing interest is the assumption that immersive virtual environments (IVE) facilitate the formation of spatial presence, generally understood as the sense of "being there". In a virtually mediated environment, the feeling of being there is of particular concern for cartographic ambitions, in terms of generating insights through geospatial representation. Current literature indicates that immersive VR systems stimulate the experience of spatial presence; however, this assumption is mainly based upon user studies in the visual communication channel. Moreover, research on IVE for geovisualization matters has to date been focused on visual-graphical rather than on auditive or even multisensory representations in virtual space. In this context, the present paper aims to evaluate the potential of audiovisual cartography with immersive virtual environments. Following a brief discussion of basic concepts, such as immersion, spatial presence and embodiment, we will integrate these aspects into a geovisualization immersion pipeline (GIP), as a framework with which to systematically link the technical and cognitive aspects of IVE. In the subsequent sections, we will examine this framework in the audio channel by analyzing how sound is implemented and perceived in GeoIVE. As we shall see, the positive effect of a combined audio-visual vs. exclusively visual presentation is supported by a series of user studies of sound effects, making audiovisual cartography with IVE a rich and worthwhile field of research.