Do you want to stay informed about this journal? Click the buttons to subscribe to our alerts.
Reducing Cybersickness in 360-Degree Virtual Reality
In: Multisensory ResearchAbstract
Despite the technological advancements in Virtual Reality (VR), users are constantly combating feelings of nausea and disorientation, the so-called cybersickness. Cybersickness symptoms cause severe discomfort and hinder the immersive VR experience. Here we investigated cybersickness in 360-degree head-mounted display VR. In traditional 360-degree VR experiences, translational movement in the real world is not reflected in the virtual world, and therefore self-motion information is not corroborated by matching visual and vestibular cues, which may trigger symptoms of cybersickness. We evaluated whether a new Artificial Intelligence (AI) software designed to supplement the 360-degree VR experience with artificial six-degrees-of-freedom motion may reduce cybersickness. Explicit (simulator sickness questionnaire and Fast Motion Sickness (FMS) rating) and implicit (heart rate) measurements were used to evaluate cybersickness symptoms during and after 360-degree VR exposure. Simulator sickness scores showed a significant reduction in feelings of nausea during the AI-supplemented six-degrees-of-freedom motion VR compared to traditional 360-degree VR. However, six-degrees-of-freedom motion VR did not reduce oculomotor or disorientation measures of sickness. No changes were observed in FMS and heart rate measures. Improving the congruency between visual and vestibular cues in 360-degree VR, as provided by the AI-supplemented six-degrees-of-freedom motion system considered, is essential for a more engaging, immersive and safe VR experience, which is critical for educational, cultural and entertainment applications.
Purchase
Buy instant access (PDF download and unlimited online access):
Institutional Login
Log in with Open Athens, Shibboleth, or your institutional credentials
Personal login
Log in with your brill.com account
-
Amores, J., Richer, R., Zhao, N., Maes, P. and Eskofier, B. M. (2018). Promoting relaxation using virtual reality, olfactory interfaces and wearable EEG, in: 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN), pp. 98–101. DOI:10.1109/BSN.2018.8329668.
-
Arns, L. L. and Cerney, M. M. (2005). The relationship between age and incidence of cybersickness among immersive environment users, in: IEEE Proceedings Virtual Reality, 2005, pp. 267–268. DOI:10.1109/VR.2005.1492788.
-
Balk, S. A., Bertola, M. A. and Inman, V. W. (2013). Simulator sickness questionnaire: twenty years later, in: Proceedings of the Seventh International Driving Symposium on Human Factors in Driver Assessment, pp. 257–263. https://doi.org/10.17077/drivingassessment.1498.
-
Bos, J. E., Bles, W. and Groen, E. L. (2008). A theory on visually induced motion sickness, Displays 29, 47–57. https://doi.org/10.1016/j.displa.2007.09.002.
-
Butler, J. S., Smith, S. T., Campos, J. L. and Bülthoff, H. H. (2010). Bayesian integration of visual and vestibular signals for heading, J. Vis. 10, 23. https://doi.org/10.1167/10.11.23.
-
Carnegie, K. and Rhee, T. (2015). Reducing visual discomfort with HMDs using dynamic depth of field, IEEE Comput. Graph. Appl. 35, 34–41. https://doi.org/10.1109/MCG.2015.98.
-
Chen, A., Gu, Y., Takahashi, K., Angelaki, D. E. and DeAngelis, G. C. (2008). Clustering of self-motion selectivity and visual response properties in macaque area MSTd, J. Neurophysiol. 100, 2669–2683. https://doi.org/10.1152/jn.90705.2008.
-
Cooper, N., Milella, F., Pinto, C., Cant, I., White, M. and Meyer, G. (2018). The effects of substitute multisensory feedback on task performance and the sense of presence in a virtual reality environment, PLoS ONE 13, e0191846. https://doi.org/10.1371/journal.pone.0191846.
-
Curry, C., Li, R., Peterson, N. and Stoffregen, T. A. (2020). Cybersickness in virtual reality head-mounted displays: examining the influence of sex differences and vehicle control, Int. J. Hum. Comput. Interact. 36, 1161–1167. https://doi.org/10.1080/10447318.2020.1726108.
-
Ehrlich, J. A. and Kolasinski, E. M. (1998). A comparison of sickness symptoms between dropout and finishing participants in virtual environment studies, Proc. Hum. Factors Ergonom. Soc. 2, 1466–1470. https://doi.org/10.1177/154193129804202101.
-
Elwardy, M., Zepernick, H.-J., Hu, Y., Chu, T. M. C. and Sundstedt, V. (2020). Evaluation of simulator sickness for 360° videos on an HMD subject to participants’ experience with virtual reality, in: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VRW), pp. 477–484. https://doi.org/10.1109/VRW50115.2020.00100.
-
Fetsch, C. R., Turner, A. H., DeAngelis, G. C. and Angelaki, D. E. (2009). Dynamic reweighting of visual and vestibular cues during self-motion perception, J. Neurosci. 29, 15601–15612. https://doi.org/10.1523/JNEUROSCI.2574-09.2009.
-
Gallagher, M. and Ferrè, E. R. (2018). Cybersickness: a multisensory integration perspective, Multisens. Res. 31, 645–674. https://doi.org/10.1163/22134808-20181293.
-
Gallagher, M., Dowsett, R. and Ferrè, E. R. (2019). Vection in virtual reality modulates vestibular-evoked myogenic potentials, Eur. J. Neurosci. 50, 3557–3565. DOI:10.1111/ejn.14499.
-
Gallagher, M., Choi, R. and Ferrè, E. R. (2020). Multisensory interactions in virtual reality: optic flow reduces vestibular sensitivity, but only for congruent planes of motion, Multisens. Res. 33, 625–644. DOI:10.1163/22134808-20201487.
-
Gavgani, A. M., Nesbitt, K. V., Blackmore, K. L. and Nalivaiko, E. (2017). Profiling subjective symptoms and autonomic changes associated with cybersickness, Auton. Neurosci. 203, 41–50. https://doi.org/10.1016/j.autneu.2016.12.004.
-
Greenlee, M. W., Frank, S. M., Kaliuzhna, M., Blanke, O., Bremmer, F., Churan, J., Cuturi, L. F., MacNeilage, P. R. and Smith, A. T. (2016). Multisensory integration in self motion perception, Multisens. Res. 29, 525–556. https://doi.org/10.1163/22134808-00002527.
-
Guna, J., Geršak, G., Humar, I., Krebl, M., Orel, M., Lu, H. and Pogačnik, M. (2020). Virtual reality sickness and challenges behind different technology and content settings, Mob. Netw. Appl. 25, 1436–1445. https://doi.org/10.1007/s11036-019-01373-w.
-
Häkkinen, J., Ohta, F. and Kawai, T. (2019). Time course of sickness symptoms with HMD viewing of 360-degree videos, J. Imaging Sci. Technol. 62, 60403-1–60403-11. https://doi.org/10.2352/J.ImagingSci.Technol.2018.62.6.060403.
-
Kennedy, R. S., Lane, N. E., Berbaum, K. S. and Lilienthal, M. G. (1993). Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness, Int. J. Aviat. Psychol. 3, 203–220. https://doi.org/10.1207/s15327108ijap0303_3.
-
Keshavarz, B. and Hecht, H. (2011). Validating an efficient method to quantify motion sickness, Hum. Factors 53, 415–426. https://doi.org/10.1177/0018720811403736.
-
Kim, H. G., Lim, H.-T., Lee, S. and Ro, Y. M. (2019b). VRSA net: VR sickness assessment considering exceptional motion for 360° VR video, IEEE Trans. Image Process. 28, 1646–1660. https://doi.org/10.1109/TIP.2018.2880509.
-
Kim, J., Luu, W. and Palmisano, S. (2020). Multisensory integration and the experience of scene instability, presence and cybersickness in virtual environments, Comput. Hum. Behav. 113, 106484. https://doi.org/10.1016/j.chb.2020.106484.
-
Kim, K., Rosenthal, M. Z., Zielinski, D. J. and Brady, R. (2014). Effects of virtual environment platforms on emotional responses, Comput. Methods Programs Biomed. 113, 882–893. https://doi.org/10.1016/j.cmpb.2013.12.024.
-
Kim, K., Lee, S., Kim, H. G., Park, M. and Ro, Y. M. (2019a). Deep objective assessment model based on spatio-temporal perception of 360-degree video for VR sickness prediction, in: Proc. int. Conf. Image Process. ICIP, pp. 3192–3196. https://doi.org/10.1109/ICIP.2019.8803257.
-
Kim, Y. Y., Kim, H. J., Kim, E. N., Ko, H. D. and Kim, H. T. (2005). Characteristic changes in the physiological components of cybersickness, Psychophysiology 42, 616–625. https://doi.org/10.1111/j.1469-8986.2005.00349.x.
-
Kolasinski, E. M. and Gilson, R. D. (1998). Simulator sickness and related findings in a virtual environment, Proc. Hum. Factors Ergonom. Soc. Annu. Meet. 42, 1511–1515. https://doi.org/10.1177/154193129804202110.
-
Lackner, J. R. and DiZio, P. (2005). Vestibular, proprioceptive, and haptic contributions to spatial orientation, Annu. Rev. Psychol. 56, 115–147. https://doi.org/10.1146/annurev.psych.55.090902.142023.
-
LaViola, J. J. (2000). A discussion of cybersickness in virtual environments, ACM SIGCHI Bull. 32, 47–56. https://doi.org/10.1145/333329.333344.
-
Li, B., Dai, Y., Chen, H. and He, M. (2017). Single image depth estimation by dilated deep residual convolutional neural network and soft-weight-sum inference, .
-
McEwen, J. D., Wallis, C. G. R., Ender, M. and d’Avezac, M. (2020). Method and system for providing at least a portion of content having six degrees of freedom motion, UK Patent GB2575932.
-
Moss, J. D. and Muth, E. R. (2011). Characteristics of head-mounted displays and their effects on simulator sickness, Hum. Factors 53, 308–319. https://doi.org/10.1177/0018720811405196.
-
Nalivaiko, E., Davis, S. L., Blackmore, K. L., Vakulin, A. and Nesbitt, K. V. (2015). Cybersickness provoked by head-mounted display affects cutaneous vascular tone, heart rate and reaction time, Physiol. Behav. 151, 583–590. https://doi.org/10.1016/j.physbeh.2015.08.043.
-
Ng, A. K. T., Chan, L. K. Y. and Lau, H. Y. K. (2020). A study of cybersickness and sensory conflict theory using a motion-coupled virtual reality system, Displays 61, 101922. https://doi.org/10.1016/j.displa.2019.08.004.
-
Padmanaban, N., Ruban, T., Sitzmann, V., Norcia, A. M. and Wetzstein, G. (2018). Towards a machine-learning approach for sickness prediction in 360° stereoscopic videos, IEEE Trans. Vis. Comput. Graph. 24, 1594–1603. DOI:10.1109/TVCG.2018.2793560.
-
Reason, J. T. (1978). Motion sickness adaptation: a neural mismatch model, J. R. Soc. Med. 71, 819–829.
-
Reason, J. T. and Brand, J. J. (1975). Motion Sickness. Academic Press, London, UK.
-
Rebenitsch, L. and Owen, C. (2014). Individual variation in susceptibility to cybersickness, in: UIST’14: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, pp. 309–317. https://doi.org/10.1145/2642918.2647394.
-
Rebenitsch, L. and Owen, C. (2016). Review on cybersickness in applications and visual displays, Virt. Real. 20, 101–125. https://doi.org/10.1007/s10055-016-0285-9.
-
Riccio, G. E. and Stoffregen, T. (1991). An ecological theory of motion sickness and postural instability, Ecol. Psychol. 3, 195–240. https://doi.org/10.1207/s15326969eco0303_2.
-
So, R. H. Y., Ho, A. and Lo, W. T. (2001). A metric to quantify virtual scene movement for the study of cybersickness: definition, implementation, and verification, Presence (Cambridge, Mass.) 10, 193–215. https://doi.org/10.1162/105474601750216803.
-
Somrak, A., Humar, I., Hossain, M. S., Alhamid, M. F., Hossain, M. A. and Guna, J. (2019). Estimating VR sickness and user experience using different HMD technologies: an evaluation study, Future Gener. Comput. Syst. 94, 302–316. https://doi.org/10.1016/j.future.2018.11.041.
-
Stanney, K. M. and Kennedy, R. S. (1997). The psychometrics of cybersickness, Commun. ACM 40, 66–68. https://doi.org/10.1145/257874.257889.
-
Stanney, K. M. and Kennedy, R. S. (1998). Aftereffects from virtual environment exposure: how long do they last?, Proc. Hum. Factors Ergonom. Soc. Ann. Meet. 42, 1476–1480. https://doi.org/10.1177/154193129804202103.
-
Stanney, K. M., Hale, K. S., Nahmens, I. and Kennedy, R. S. (2003). What to expect from immersive virtual environment exposure: influences of gender, body mass index, and past experience, Hum. Factors 45, 504–520. https://doi.org/10.1518/hfes.45.3.504.27254.
-
Stoffregen, T., Chen, Y.-C. and Koslucher, F. C. (2014). Motion control, motion sickness, and the postural dynamics of mobile devices, Exp. Brain Res. 232, 1389–1397. https://doi.org/10.1007/s00221-014-3859-3.
-
Vickers, A. J. (2005). Parametric versus non-parametric statistics in the analysis of randomized trials with non-normally distributed data, BMC Med. Res. Methodol. 5, 35. https://doi.org/10.1186/1471-2288-5-35.
-
Weech, S., Moon, J. and Troje, N. F. (2018). Influence of bone-conducted vibration on simulator sickness in virtual reality, PLoS ONE 13, e0194137. https://doi.org/10.1371/journal.pone.0194137.
-
Yildirim, C. (2019). Cybersickness during VR gaming undermines game enjoyment: a mediation model, Displays 59, 35–43. https://doi.org/10.1016/j.displa.2019.07.002.
-
Yu, F. and Koltun, V. (2016). Multi-scale context aggregation by dilated convolutions, in: 4th int. Conf. Learn. Represent. ICLR.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 1434 | 909 | 55 |
| Full Text Views | 96 | 69 | 4 |
| PDF Views & Downloads | 184 | 124 | 9 |
Reducing Cybersickness in 360-Degree Virtual Reality
In: Multisensory ResearchAbstract
Despite the technological advancements in Virtual Reality (VR), users are constantly combating feelings of nausea and disorientation, the so-called cybersickness. Cybersickness symptoms cause severe discomfort and hinder the immersive VR experience. Here we investigated cybersickness in 360-degree head-mounted display VR. In traditional 360-degree VR experiences, translational movement in the real world is not reflected in the virtual world, and therefore self-motion information is not corroborated by matching visual and vestibular cues, which may trigger symptoms of cybersickness. We evaluated whether a new Artificial Intelligence (AI) software designed to supplement the 360-degree VR experience with artificial six-degrees-of-freedom motion may reduce cybersickness. Explicit (simulator sickness questionnaire and Fast Motion Sickness (FMS) rating) and implicit (heart rate) measurements were used to evaluate cybersickness symptoms during and after 360-degree VR exposure. Simulator sickness scores showed a significant reduction in feelings of nausea during the AI-supplemented six-degrees-of-freedom motion VR compared to traditional 360-degree VR. However, six-degrees-of-freedom motion VR did not reduce oculomotor or disorientation measures of sickness. No changes were observed in FMS and heart rate measures. Improving the congruency between visual and vestibular cues in 360-degree VR, as provided by the AI-supplemented six-degrees-of-freedom motion system considered, is essential for a more engaging, immersive and safe VR experience, which is critical for educational, cultural and entertainment applications.
| All Time | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 1434 | 909 | 55 |
| Full Text Views | 96 | 69 | 4 |
| PDF Views & Downloads | 184 | 124 | 9 |