Search Results
Abstract
Integration of incoming sensory signals from multiple modalities is central in the determination of self-motion perception. With the emergence of consumer virtual reality (VR), it is becoming increasingly common to experience a mismatch in sensory feedback regarding motion when using immersive displays. In this study, we explored whether introducing various discrepancies between the vestibular and visual motion would influence the perceived timing of self-motion. Participants performed a series of temporal-order judgements between an auditory tone and a passive whole-body rotation on a motion platform accompanied by visual feedback using a virtual environment generated through a head-mounted display. Sensory conflict was induced by altering the speed and direction by which the movement of the visual scene updated relative to the observer’s physical rotation. There were no differences in perceived timing of the rotation without vision, with congruent visual feedback and when the speed of the updating of the visual motion was slower. However, the perceived timing was significantly further from zero when the direction of the visual motion was incongruent with the rotation. These findings demonstrate the potential interaction between visual and vestibular signals in the temporal perception of self-motion. Additionally, we recorded cybersickness ratings and found that sickness severity was significantly greater when visual motion was present and incongruent with the physical motion. This supports previous research regarding cybersickness and the sensory conflict theory, where a mismatch between the visual and vestibular signals may lead to a greater likelihood for the occurrence of sickness symptoms.
Abstract
The integration of vestibular, visual and body cues is a fundamental process in the perception of self-motion and is commonly experienced in an upright posture. However, when the body is tilted in an off-vertical orientation these signals are no longer aligned relative to the influence of gravity. In this study, the perceived timing of visual motion was examined in the presence of sensory conflict introduced by manipulating the orientation of the body, generating a mismatch between body and vestibular cues due to gravity and creating an ambiguous vestibular signal of either head tilt or translation. In a series of temporal-order judgment tasks, participants reported the perceived onset of a visual scene simulating rotation around the yaw axis presented in virtual reality with a paired auditory tone while in an upright, supine and side-recumbent body position. The results revealed that the perceived onset of visual motion was further delayed from zero (i.e., true simultaneity between visual onset and a reference auditory tone) by approximately an additional 30 ms when viewed in a supine or side-recumbent orientation compared to an upright posture. There were also no significant differences in the timing estimates of the visual motion between all the non-upright orientations. This indicates that the perceived timing of visual motion is negatively impacted by the presence of conflict in the vestibular and body signals due to the direction of gravity and body orientation, even when the mismatch is not in the direct plane of the axis of rotation.