CPL - Chalmers Publication Library
| Utbildning | Forskning | Styrkeområden | Om Chalmers | In English In English Ej inloggad.

Sound for Multisensory Motion Simulators

Aleksander Väljamäe (Institutionen för bygg- och miljöteknik, Teknisk akustik, Rumsakustik)
Göteborg : Chalmers University of Technology, 2007. ISBN: 978-91-7291-987-7.- 162 s.
[Doktorsavhandling]

Interaction in a virtual reality environment often implies situations of illusory self-motion, like, for example, in flight or driving scenarios. Striving for pictorial realism, currently available motion simulators often exhibit relatively poor sound design. However, a substantial body of research has now conclusively shown that human perception is multisensory in its nature. It is, therefore, logical to assume that acoustic information should contribute to the perception of illusory self-motion (vection). The presented studies used an iterative synthesis-evaluation loop where participants’ vection and presence (the sense of “being there”) responses guided the search for the most salient auditory cues and their multisensory combinations. Paper A provides a first integrative review on the studies related to auditory induced illusory vection, which have been scattered over time and different research disciplines. Paper B explores optimal combinations of perceptual cues between vision (field-of-view) and audition (spatial resolution) when presenting a rotating environment. Paper C examines cognitive factors in purely auditory or auditory-vibrotactile induced circular vection. In Paper D the specific influence of an audio-vibrotactile engine sound metaphor on linear vection responses are evaluated. The idea of using the engine sound representing self-motion or its multisensory counterparts is further addressed in Paper E where participant’s imagery vividness scores are also considered. The results from Papers B-E serve as a basis for the design of a transportable, multimodal motion simulator prototype. In paper F the feasibility of inducing vection by means of binaural bone conducted sound is tested using this prototype. Paper G outlines perceptually optimized, multisensory design which can be used in future motion simulators and discusses its possible implications for entertainment industries. To conclude, sound is an important but often neglected component in multisensory self-motion simulations, providing both perceptual and cognitive cues. Hence, it might be beneficial to think in terms of the amodal categories of unitary space, time, objects and events rather than to optimize vection cues in different modalities separately. The presented results have implications for various research areas including multisensory integration of self-motion cues, posture prosthesis, navigation in unusual gravitoinertial environments and applications for visually impaired.

Nyckelord: 'virtual reality, spatial audio, auditory scene synthesis, cognitive acoustics, multisensory optimization, presence, illusory self-motion, vection'



Denna post skapades 2007-08-13. Senast ändrad 2013-09-25.
CPL Pubid: 44880

 

Institutioner (Chalmers)

Institutionen för bygg- och miljöteknik, Teknisk akustik, Rumsakustik

Ämnesområden

Kognitionsvetenskap

Chalmers infrastruktur

Relaterade publikationer

Inkluderade delarbeten:


Vibrotactile enhancement of auditory induced self-motion and spatial presence


Examination

Datum: 2007-09-12
Tid: 10:00
Lokal: VK 1121, Sven Hultins gata 6, Chalmers University of Technology
Opponent: Prof. Jack Loomis, Department of Psychology, University of California, Santa Barbara, USA

Ingår i serie

Doktorsavhandlingar vid Chalmers tekniska högskola. Ny serie 2668