- CONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality
- Edited by Pietro Capone, Vito Getuli, Farzad Pour Rahimian, Nashwan Dawood, Alessandro Bruttini, Tommaso Sorbi
Enhancing the Realism of Virtual Construction Safety Training: Integration of Real-Time Location Systems for Real-World Hazard Simulations
- Kilian Speiser
- Kepeng Hong
- Jochen Teizer
- © 2023 Author(s) |
- CC BY-NC 4.0
- DOI: 10.36253/979-12-215-0289-3.15
In numerous studies, virtual training for construction safety has been proposed as a promising approach. However, creating realistic training scenarios requires significant resources, encompassing various elements such as sound, graphics, agent behavior, and realistic hazards. Digital Twins have revolutionized this process, and although so far, on a conceptual level only, significantly reducing the associated workload, it is still not exploiting its full potential. In this work, we propose a novel approach that leverages Real-time Location Systems (RTLS) data to simulate the real-world behavior of construction workers and equipment within Virtual Training Environments (VTEs). We aim to create training scenarios with dynamic real-world instead of hardcoded made-up hazardous events. To achieve this, we propose an extension to our Digital Twin for Construction Safety (DTCS) framework that now integrates (a) trajectory data streams of construction personnel and equipment and (b) technical specifications of the construction site work environment, including location and geometry of terrain and surface objects, to simulate real-world hazards in virtual safety training scenarios. Our further contribution is a case study application to explore the DTCS training capacity. Applying a logical filtering algorithm, we can process the RTLS data and ensure that the movements of the workers and equipment within the virtual environment are as realistic and representative as within the real world. This then enables the creation of realistic hazards that trainees can encounter in the training phase. Preliminary results with trainees suggest that the proposed work can have a high potential to enhance the realism of safety training, especially when they need to experience human-machine-related interactions safely. However, further work is required to create more responsive learning environments where the equipment follows real trajectories but also responds intelligently to the trainees' actions. By leveraging real-time data and advanced visualization technologies, we bridge the gap between the physical and virtual realms, enabling trainees to interact and navigate within a realistic virtual environment
- Keywords:
- Construction Safety,
- Digital Twins,
- Education and Training,
- Game Engines,
- Internet of Things,
- Learning Environments,
- Mixed and Virtual Reality,
- Real-Time-Location System,
- Real-world Hazards,
Technical University of Denmark, Denmark - ORCID: 0000-0001-8428-8053
Technical University of Denmark, Denmark - ORCID: 0009-0005-0018-0579
Technical University of Denmark, Denmark - ORCID: 0000-0001-8071-895X
- Adami, P., Singh, R., Borges Rodrigues, P., Becerik-Gerber, B., Soibelman, L., Copur-Gencturk, Y., & Lucas, G. (2023). Participants matter: Effectiveness of VR-based training on the knowledge, trust in the robot, and self-efficacy of construction workers and university students. Advanced Engineering Informatics, 55. DOI: 10.1016/j.aei.2022.101837
- Azmandian, M., Hancock, M., Benko, H., Ofek, E., & Wilson, A.D. (2016). Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. Conference on Human Factors in Computing Systems - Proceedings. DOI: 10.1145/2858036.2858226
- Bükrü, S., Wolf, M., Böhm, B., König, M., & Teizer, J. (2020). Augmented virtuality in construction safety education and training. Proceedings of the European Group for Intelligent Computing in Engineering Conference (EG-ICE), Berlin, Germany, 115-124.
- Bureau of Labor Statistics (2022). National census of fatal occupational injuries in 2021. https://www.bls.gov/news.release/pdf/cfoi.pdf
- Chae, S., & Yoshida, T. (2010). Application of RFID technology to prevention of collision accident with heavy equipment. Automation in Construction, 19(3). DOI: 10.1016/j.autcon.2009.12.008
- Fang, Y., & Teizer, J. (2014). A Multi-user Virtual 3D Training Environment to Advance Collaboration among Crane Operator and Ground Personnel in Blind Lifts. International Conference on Computing in Civil and Building Engineering Conference, 2071-2078, DOI: 10.1061/9780784413616.257
- Golovina, O., Kazanci, C., Teizer, J., & König, M. (2019a). Using serious games in virtual reality for automated close call and contact collision analysis in construction safety. Proceedings of the 36th International Symposium on Automation and Robotics in Construction, ISARC 2019 DOI: 10.22260/isarc2019/0129
- Golovina, O., Perschewski, M., Teizer, J., & König, M. (2019b). Algorithm for quantitative analysis of close call events and personalized feedback in construction safety. Automation in Construction, 99, 206-222, DOI: 10.1016/j.autcon.2018.11.014
- Golovina, O., & Teizer, J. (2022). Serious game in Virtual Reality for Safe, Active, and Personalized Learning related to Pedestrian Workers Struck By Equipment and other Construction Hazards. 22nd Conference on Construction Application of Virtual Reality (CONVR), 260–271. ISBN: 978-0-9927161-4-1.
- Grieves, M., & Vickers, J. (2016). Digital twin: Mitigating unpredictable, undesirable emergent behavior in complex systems. In Transdisciplinary Perspectives on Complex Systems: New Findings and Approaches. DOI: 10.1007/978-3-319-38756-7_4
- Hilfert, T., Teizer, J., & König, M. (2016). First Person Virtual Reality for Evaluation and Learning of Construction Site Safety. 33rd International Symposium on Automation and Robotics in Construction, Auburn, Alabama, USA, DOI: 10.22260/ISARC2016/0025
- Jacobsen, E. L., Solberg, A., Golovina, O., & Teizer, J. (2022). Active personalized construction safety training using run-time data collection in physical and virtual reality work environments. Construction Innovation, 22(3). DOI: 10.1108/CI-06-2021-0113
- Jelonek, M., Fiala, E., Hermann, T., Teizer, J., Embers, S., Koenig, M., Mathis, A. (2022). Evaluating Virtual Reality Simulations for Construction Safety Training – A User Study Exploring Learning Effects, Usability and User Experience. Journal of Interactive Media, 21(2), 269-281, DOI: 10.1515/icom-2022-0006
- Juang, J. R., Hung, W. H., & Kang, S. C. (2011). Using game engines for physics-based simulations - A forklift. Electronic Journal of Information Technology in Construction, 16, 3–22.
- Kim, A., Darakjian, N., & Finley, J.M. (2017). Walking in fully immersive virtual environments: an evaluation of potential adverse effects in older adults and individuals with Parkinson's disease. Journal of NeuroEngineering and Rehabilitation, 14(1). DOI: 10.1186/s12984-017-0225-2
- Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1994). Mixed Reality (MR) Reality-Virtuality (RV) Continuum. Systems Research, 2351(Telemanipulator and Telepresence Technologies).
- Narumi, T., Aoki, S., Yokoshima, T., Uyama, N., Fukushima, S., Tabuchi, G., Kanamori, H., & Wakabayashi, S. (2018). Preliminary system design for teleoperating construction in extreme environments. ISARC 2018 - 35th International Symposium on Automation and Robotics in Construction and International AEC/FM Hackathon: The Future of Building Things. DOI: 10.22260/isarc2018/0038
- Park, J., Kim, K., & Cho, Y.K. (2017). Framework of Automated Construction-Safety Monitoring Using Cloud-Enabled BIM and BLE Mobile Tracking Sensors. Journal of Construction Engineering and Management, 143(2). DOI: 10.1061/(asce)co.1943-7862.0001223
- Pianta, R. C., Hamre, B.K., & Allen, J.P. (2012). Teacher-student relationships and engagement: Conceptualizing, measuring, and improving the capacity of classroom interactions. In Handbook of Research on Student Engagement. DOI: 10.1007/978-1-4614-2018-7_17
- Pyproj Contributors (2023). Pyproj: Python interface to PROJ. https://pyproj4.github.io/pyproj/stable/index.html
- Sacks, R., Brilakis, I., Pikas, E., Xie, H.S., & Girolami, M. (2020). Construction with digital twin information systems. Data-Centric Engineering, 1(6). DOI: 10.1017/dce.2020.16
- Sacks, R., Perlman, A., & Barak, R. (2013). Construction safety training using immersive virtual reality. Construction Management and Economics, 31(9) DOI: 10.1080/01446193.2013.828844
- Savioja, L., & Svensson, U P. (2015). Overview of geometrical room acoustic modeling techniques. The Journal of the Acoustical Society of America, 138(2). DOI: 10.1121/1.4926438
- Skarbez, R., Smith, M., & Whitton, M.C. (2021). Revisiting Milgram and Kishino's Reality-Virtuality Continuum. Frontiers in Virtual Reality, 2. DOI: 10.3389/frvir.2021.647997
- Speiser, K., Teizer, J. (2023a). An efficient approach for generating training environments in virtual reality using a digital twin for construction safety. Proceedings of CIBW099W123, Porto, Portugal. 481-490. ISBN: 978-972-752-309-2. DOI: 10.24840/978-972-752-309-2
- Speiser, K., & Teizer, J. (2023b). An Ontology-Based Data Model to Create Virtual Training Environments for Construction Safety Using BIM and Digital Twins. 30th European Group for Intelligent Computing in Engineering Conference (EG-ICE), London, UK.
- Teizer, J., Cheng, T., and Fang, Y. (2013). Location Tracking and Data Visualization Technology to Advance Construction Ironworkers' Education and Training in Safety and Productivity. Automation in Construction, Elsevier, 35, 53-68, DOI: 10.1016/j.autcon.2013.03.004
- Teizer, J., Johansen, K.W., Schultz, C.L., Speiser, K., Hong, K., Golovina, O. (2024). A Digital Twin Model for Advancing Construction Safety. J. Fottner et al. (Eds.): CLEaR 2023, Lecture Notes in Civil Engineering (LNCE 390), ISBN: 978-3-031-44020-5, pp. 201–212, DOI: 10.1007/978-3-031-44021-2_22
- Teizer, J., Venugopal, M., & Walia, A. (2008). Ultrawideband for automated real-time three-dimensional location sensing for workforce, equipment, and material positioning and tracking. Transportation Research Record, 2081. DOI: 10.3141/2081-06
- Wang, P., Wu, P., Wang, J., Chi, H.L., & Wang, X. (2018). A critical review of the use of virtual reality in construction engineering education and training. In International Journal of Environmental Research and Public Health (Vol. 15, Issue 6). DOI: 10.3390/ijerph15061204
- Wielgocka, N., Hadas, T., Kaczmarek, A., & Marut, G. (2021). Feasibility of Using Low-Cost Dual-Frequency GNSS Receivers for Land Surveying. Sensors, 21(6), 1956. DOI: 10.3390/s21061956
- Wolf, M., Teizer, J., & Ruse, J.H. (2019). Case Study on Mobile Virtual Reality Construction Training. 36th International Symposium on Automation and Robotics in Construction, Banff, Canada, DOI: 10.22260/ISARC2019/0165
- Wolf., M., Teizer, J., Wolf, B., Bükrü, S., & Solberg, A. (2022). Investigating hazard recognition in augmented virtuality for personalized feedback in construction safety education and training. Advanced Engineering Informatics, 51, 101469, DOI: 10.1016/j.aei.2021.101469
- Yanagida, Y. (2012). A survey of olfactory displays: Making and delivering scents. Proceedings of IEEE Sensors. DOI: 10.1109/ICSENS.2012.6411380
- Zoleykani, M. J., Abbasianjahromi, H., Banihashemi, S., Tabadkani, S. A., & Hajirasouli, A. (2023). Extended reality (XR) technologies in the construction safety: systematic review and analysis. Construction Innovation. DOI: 10.1108/CI-05-2022-0131
- Salinas, D., Muñoz-La Rivera, F., & Mora-Serrano, J. (2022). Critical Analysis of the Evaluation Methods of Extended Reality (XR) Experiences for Construction Safety. International Journal of Environmental Research and Public Health, 19(22). DOI: 10.3390/ijerph192215272
Chapter Information
Chapter Title
Enhancing the Realism of Virtual Construction Safety Training: Integration of Real-Time Location Systems for Real-World Hazard Simulations
Authors
Kilian Speiser, Kepeng Hong, Jochen Teizer
DOI
10.36253/979-12-215-0289-3.15
Peer Reviewed
Publication Year
2023
Copyright Information
© 2023 Author(s)
Content License
Metadata License
Bibliographic Information
Book Title
CONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality
Book Subtitle
Managing the Digital Transformation of Construction Industry
Editors
Pietro Capone, Vito Getuli, Farzad Pour Rahimian, Nashwan Dawood, Alessandro Bruttini, Tommaso Sorbi
Peer Reviewed
Publication Year
2023
Copyright Information
© 2023 Author(s)
Content License
Metadata License
Publisher Name
Firenze University Press
DOI
10.36253/979-12-215-0289-3
eISBN (pdf)
979-12-215-0289-3
eISBN (xml)
979-12-215-0257-2
Series Title
Proceedings e report
Series ISSN
2704-601X
Series E-ISSN
2704-5846