Individual Web Page James Bickerstaff
I am a first year student from Erie, PA, who intends on studying computer engineering.
Menu

A Grand Challenge in the Field of Engineering:Virtual Reality

THE SIGNIFICANCE OF VIRTUAL REALITY DEVELOPMENT

     The further development of virtual reality systems will be beneficial to all realms of society for multiple reasons, these reasons may vary from recreational uses, like in video games, to more applicable uses, such as in the training of various skills in the field of medicine. For example, virtual reality in training for surgical procedures has proven to be very effective, so much that it may be more useful than traditional training or can be used as a powerful supplement to traditional methods [1,2]. In addition, virtual reality development has made steps towards aiding in the redevelopment of skills for those who have suffered from strokes or other diseases [3].

    This topic is significant in the field of engineering because this is a very difficult challenge that needs much work to be overcome [4]. The development presents several hurdles that must be done to achieve the best experience from virtual reality, and these developments include fine tuning sounds, touch, and visuals [4]. If these issues are resolved they would be great technological advances not only in the field of virtual reality but throughout all of engineering as well.

    I believe this is important to myself, because I am aspiring to be a computer engineer, and it is in my field that much of the development of virtual reality systems will be done. Thus, it is quite possible that at some point in the future that I will become more involved in this topic. Also, I find this virtual reality technology to be very interesting and complex, and am interested in finding out more about it and how it can be used.

SENSORY ASPECTS OF VIRTUAL REALITY

    Technological advances that could be made in the virtual reality field to increase the usage and effectiveness of this technology in the hands of doctors, as well as the redevelopment of skills vary. A change that can be implemented or refined is the sensation of touching objects in the simulated world [8]. Another change that could be made is fine tuning the details of the virtual world to create a much stronger illusion and simulation of the real world [4].

    Refining the feeling of touching something within the virtual world is one of the most important concepts. This is because, in surgery, for example, when a user cuts into or interacts with human skin, bone, or anything else, the feeling must be near perfect so that training surgeons may get the proper idea of what it will feel like [8]. In addition to this, while virtual reality is in use with patients such as those suffering from multiple sclerosis, or MS, they must be able to properly feel what they are walking on or touching so that they may develop better balance when they exit the simulation, as stated by Kalron, author of “Using a virtual reality system to improve balance for those with multiple sclerosis” [9]. For example, Calabro and Russo, two of the authors of the article, “Robotic gait training in multiple sclerosis rehabilitation: can virtual reality make the difference? Findings from a randomized controlled trial,” depict that virtual reality plays a pivotal role in motor rehabilitation, as it provides repetitive and accurate tactile input, which leads to a greater redevelopment of skills [6]. These are just two examples of how touch is an important aspect of virtual reality.

    The visual aspects of virtual reality are just as important, if not more so than the feeling of touch in the virtual world. In research done by Thomsen, author of the article, “Intra-ocular surgery-assessment and transfer of skills using a virtual-reality simulator,” explains a trial done by which surgeons practiced cataract surgery in virtual reality, and later had done it on a real patient [5]. For this sort of trial to be done and accurately compared, there must be a perfect recreation of this type of surgery in the virtual world with both the visuals and feel. In the MS study by Calabro and Russo, the patients’ avatars (figures representing the patients in the virtual world) were placed in the middle of the screen, while requiring them to pass obstacles, catch objects, and more throughout the trial [6]. The only way this treatment can work is for the MS patients to be able to see the objects in their path, and time their reactions accordingly, meaning the visuals must be properly in sync with the feedback given to them in all forms.

    For these types of treatments and training to work properly, engineers must do their part and create systems that can accurately recreate these sorts of visuals, tactile feels, sounds, and more. As stated in the article “Enhance Virtual Reality” on the National Academy of Engineering’s website, not only does there need to be great graphics and a fast refresh rate so that things in the virtual world appear and change as they do in the real one, but accurate shadows and lighting must also be implemented [4]. In addition to this, it is explained that accurate reproduction of sound and touch must be done as well, since only minor improvements have been made thus far [4]. These challenges may take a fair amount of time due to their difficulty, and because of this, is why this topic is of importance to me as well. I may get the opportunity to contribute to these works and advances in technology.

VIRTUAL REALITY IN ACTION

    There have been several studies done in recent years by various departments, medical centers, PHD students, and more regarding virtual reality in the medical field. The examples that will be presented will cover several projects and procedures, showing not only how useful virtual reality can be and how it may develop into an even more crucial tool, but how broad of a spectrum this tool may be used for.

    Wang and Zhao are two of the authors behind the article, “Preliminary evaluation of a virtual reality dental simulation system on drilling operation,” and throughout the article they depict the usefulness of virtual reality as a tool in training for dental procedures [1]. One point that is explained by the authors is that in traditional training methods for drilling procedures, practice is limited to the number of extracted teeth they had, but with virtual reality, training for these types of procedures can be done any number of times at any given time [1]. It is further stated that the feeling of resistance given off by teeth in the simulation plays an important role, and that this aspect is present and aids the process, but this function needs to be more precise in the future, however [1]. The visuals are also passable, allowing trainees to see exactly how far they are drilling and what parts are all present, but it is explained that the resolutions and graphics need to be improved to maximize efficiency [1]. Wang and Zhao close by stating, dentists were positive towards the potential of the simulation and are optimistic about its future, as there is much that can be improved upon [1].

    A trial done by Siu and Kim, the authors of “Adaptive Virtual Reality Training to Optimize Military Medicine Skills Acquisition and Retention,” explain the usage of virtual reality in training doctors in the military. In their experiment, there was a control group that was trained skills, methods, and kinematics through an adaptive virtual reality trainer, while another group was taught all the same things traditionally [2]. They were then tested on these things taught them with two different simple surgical procedures, and had their performances timed [2]. What was discovered is that the adaptive virtual reality training improved the users’ skill relearning, retaining, and maintenance, while showing lower times taken for the surgical training tasks than those with the traditional method of learning [2]. It is acknowledged at the end of the article, however, that though it is not perfect, given time the system could eventually reduce patient injury and morbidity through providing trainees with the proper experience needed [2].

    The article “Effect of Virtual Reality on Postural and Balance Control in Patients with Stroke: A Systematic Literature Review,” written by authors Chen, Lo and others, discusses the effect of using virtual reality to improve balance and motion with those who have suffered from various kinds of strokes [3]. The data presented is a compilation of data from approximately 434 articles in databases [3]. Trials done included placing the patient into a realistic virtual reality, composed of “multisensory stimulation of visual, auditory, tactile, and somatosensory systems to provide a realistic environment” [3]. In these various worlds the patients’ balance, gait, and postural control would be tested and improved upon through several repetitive testing sessions [3]. The results of these tests concluded that the realistic virtual reality training, with all the sensory additions, acted as an effective addition to standard rehabilitation programs, and was in some cases, a very effective way to improve static and dynamic balance [3].

MY TAKE ON VIRTUAL REALITY

    I personally believe virtual reality will make a very large difference in the future of medical testing, rehabilitation and more. This is because it is very adaptable and flexible to almost any scenario that can be thought of, and because of this, there will always be new developments created so that these needs may be met. An uncountable number of tests and training simulators can be made, and when the technology becomes very precise, it will revolutionize training and learning. In addition, there will always be something to improve upon, and because of this, I feel that virtual reality will have an ever-growing role in the future of society and engineering.

CONCLUSION: VIRTUAL REALITY HAS A BIG FUTURE

    Virtual reality has developed over recent years to become a very useful tool in the medical field, as it provides many new opportunities. Doctors or dentists may use this to practice surgery whenever they please, without having to be limited by supplies or worried about waste products. Stroke or MS sufferers may use this as a rehabilitation tool, providing instant feedback on tests, as well as pleasant environments for patients to explore and work on redeveloping themselves in. Many aspects are in need to be improved upon, however, and this is where engineering comes in. These issues are ones that must be solved through new, adaptive thinking, and coming up with fresh ideas using various programs and technologies developed by engineering departments, such as computer engineering. Lastly, this topic is important to myself because not only am I fascinated by virtual reality technology and its development, but I am aspiring to be a computer engineer, and may get to play a part in this development someday.

SOURCES

  1. D. Wang, S. Zhao, T. Li, Y. Zhang, X. Wang. “Preliminary evaluation of a virtual reality dental simulation system on drilling operation.” IOS Press. 2015. Accessed 10.27.2017. DOI 10.3233/BME-151366.
  2. K. Siu, B. Best, J. Kim, D. Oleynikov, F. Ritter. “Adaptive Virtual Reality Training to Optimize Military Medicine Skills Acquisition and Retention.” MILITARY MEDICINE. 05.N/A.2016 Accessed 10.27.2017. DOI 10.7205/MILMED-D-15-00164.
  3. L. Chen, W. Lo, Y. Mao, M. Ding, Q. Lin, H. Li, J. Zhao, Z. Xu, R. Bian, D. Huang. “Effect of Virtual Reality on Postural and Balance Control in Patients with Stroke: A Systematic Literature Review.” BioMed Research International. 06.23.2016. Accessed 10.27.2017. https://www.hindawi.com/journals/bmri/2016/7309272/
  4. “Enhance Virtual Reality.” National Academy of Engineering Grand Challenges For Engineering. 2017. Accessed 10.27.2017. http://www.engineeringchallenges.org/challenges/virtualreality.aspx
  5. A. Thomsen. “Intra-ocular surgery-assessment and transfer of skills using a virtual-reality simulator.” Acta Ophthalmologica. 09.02.2017. Accessed 10.29.2017. 10.1111/aos.13505.
  6. R. Calabro, M. Russo, A. Naro, R. Luca, A. Leo, P. Tomasello, F. Molonia, V. Dattola, A. Bramanti, P Bramanti. “Robotic gait training in multiple sclerosis rehabilitation: can virtual reality make the difference? Findings from a randomized controlled trial.” Journal of the Neurological Sciences. 03.29.2017. Accessed 10.27.2017. https://doi.org/10.1016/j.jns.2017.03.047.
  7. A. Thomsen, D. Bach-Holm, H. Kjaerbo, K. Hojgaard-Olsen, Y. Subhi, G. Saleh, Y. Park, M. Cour, L. Konge. “Operating Room Performance Improves after Proviciency-Based Virtual Reality Cataract Surgery Training.” American Academy of Ophthalmology. 2017. Accessed 10.27.2017. http://www.sciencedirect.com/science/article/pii/S0161642016311605?via%3Dihub.
  8. J. Best. “Surgery in virtual reality: How VR could give trainee doctors the feel of real patients.” ZDNet. 06.1.2017. Accessed 10.29.2017. http://www.zdnet.com/article/how-vr-could-give-trainee-doctors-the-feel-of-real-surgery/.
  9. A. Kalron. “Using a virtual reality system to improve balance for those with multiple sclerosis.” Biomedical Central. 03.01.2016. Accessed 10.29.2017. http://blogs.biomedcentral.com/on-medicine/2016/03/01/effect-balance-training-people-multiple-sclerosis-using-virtual-reality-system/.

ACKNOWLEDGMENTS

I would like to thank my Mom and Dad for supporting me whenever I felt overwhelmed by this paper and giving me confidence. I would also like to thank my friends and roommate for keeping me on track and motivated when writing this paper.