Mixed Reality Improves Education and Training in Assembly Processes
Keywords:augmented reality (AR), mixed reality, unity, virtual reality (VR), Vuforia
AbstractMixed reality is the outcome of blending the physical world with the digital world, made possible by technological advancement. Mixed reality is the next evolution in human, computer, and environment interaction. Augmented reality (AR) uses a virtual model of the real world, augmented by using a computer to see the real environment through a special display device. Current education and training systems in the engineering maintenance field are still insufficiently directed at the psychomotor skills in learning about machine parts, which makes them less effective for trainees. The oil and gas industry always face problems related to inefficiency due to downtime of critical equipment. This study was conducted at designing and developing a virtual reality (VR) and augmented reality (AR) system as a learning and training platform. This work also reviewed AR applications for machine part maintenance and assembly. An AR system was modelled and developed using the following software: CATIA, Blender, Unity and Vuforia. The effectiveness of using the AR technique in an education and training process was evaluated with 20 respondents among university students. The results showed that using this AR app enhanced the participant's understanding according to certain criteria and can be adopted as a learning method.
Van Krevelen, D.W.F. & Poelman, R., A Survey of Augmented Reality Technologies, Applications and Limitations, International Journal of Virtual Reality, 9(2), pp. 1-20, 2010.
Milgram, P. & Kishino, F., A Taxonomy of Mixed Reality Visual Displays,
IEICE Transactions on Information Systems, E77-D (12), pp. 1321-1329, 1994.
Kaufmann, H., Schmalstieg, D. & Wagner, M., Construct3D: A Virtual Reality Application for Mathematics and Geometry Education, Education and Information Technologies, 5(4), pp. 263-276, 2000.
Pantelidis, P., Chorti, A., Papagiouvanni, I., Paparoidamis, G., Drosos, C., Panagiotakopoulos, T., Lales, G. & Sideris, M., Virtual and Augmented Reality in Medical Education. 10.5772/intechopen.71963, 2018.
Olanrewaju, O.A., Faieza, A.A. & Syakirah, K., Current Trend of Robotics Application in Medical, Paper presented at the IOP Conference Series: Materials Science and Engineering, 46(1), p. 012041, 2013.
Vaughan, N., Gabrys, B. & Dubey, V.N., An Overview of Self-Adaptive Technologies Within Virtual Reality Training, Computer Science Review, 22, pp. 65-87, 2016.
Bazarov, S.E., Kholodilin, I.Y., Nesterov, A.S. & Sokhina, A.V., Applying Augmented Reality in Practical Classes for Engineering Students, In IOP Conference Series: Earth and Environmental Science, 87(3), pp. 032004. IOP Publishing, 2017.
Olmedo, H. & Augusto, J., Towards the Commodification of Augmented Reality: Tools and Platforms, in New Trends in Interaction, Virtual Reality and Modeling, Springer, London, pp. 63-72, 2013.
Rohidatun, M.W., Faieza, A.A., Rosnah, M.Y., Nor Hayati, S. & Rahinah, I., Development of Virtual Reality (VR) System with Haptic Controller and Augmented Reality (AR) System to Enhance Learning and Training Experience, International Journal of Applied Engineering Research, 11(16), pp. 8806-8809, 2016.
Blackley David, J., Retzer Kyla, D., Hubler Warren, G., Hill Ryan, D. & Laney, A.S., Injury Rates on New and Old Technology Oil and Gas Rigs Operated by the Largest United States Onshore Drilling Contractor, American Journal of Industrial Medicine, 57(10), pp. 1188-1192, 2014.
Lu, S. & Li, X., Analysis of the Manufacturing Process and Development of Valves, 2011.
Sapuan, S.M., Ham, K.W., Ng, K.M., Woo, C.K., Ariffin, M.K.A., Baharudin, B. & Faieza, A.A., Design of Composite Racing Car Body for Student Based Competition, Scientific Research and Essays, 4(11), pp 1151-1162, 2009.
Montoya, M.H., Diaz, C. & Moreno, G.A., Evaluating the Effect on User Perception and Performance of Static and Dynamic Contents Deployed in Augmented Reality based Learning Application, 2017.
Smith, B., An Approach to Graphs of Linear Forms, Unpublished Work Style, (unpublished).
Cai, S., Liu, E., Yang, Y. & Liang, J.C., Tablet-Based AR Technology: Impacts on Students' Conceptions and Approaches to Learning Mathematics According to their Self-Efficacy, British Journal of Educational Technology, John Wiley & Sons Ltd., 50(1), pp 248-263, 2019.