Contained in:
Book Chapter

Deep Learning-Based Pose Estimation for Identifying Potential Fall Hazards of Construction Worker

  • Minsoo Park
  • Seungsoo Lee
  • Woonggyu Choi
  • Yuntae Jeon
  • Dai Quoc Tran
  • Seunghee Park

Fall from height (FFH) is one of the major causes of injury and fatalities in construction industry. Deep learning-based computer vision for safety monitoring has gained attention due to its relatively lower initial cost compared to traditional sensing technologies. However, a single detection model that has been used in many related studies cannot consider various contexts at the construction site. In this paper, we propose a deep learning-based pose estimation approach for identifying potential fall hazards of construction workers. This approach can relatively increase the accuracy of estimating the distance between the worker and the fall hazard area compared to the existing methods from the experimental results. Our proposed approach can improve the robustness of worker location estimation compared to existing methods in complex construction site environments with obstacles that can obstruct the worker's position. Also, it is possible to provide information on whether a worker is aware of a potential fall risk area. Our approach can contribute to preventing FFH by providing access information to fall risk areas such as construction site openings and inducing workers to recognize the risk area even in Inattentional blindness (IB) situations

  • Keywords:
  • deep learning,
  • keypoint detection,
  • pose estimation,
  • computer vision,
  • construction site safe,
+ Show More

Minsoo Park

Sungkyunkwan University, Korea (the Republic of) - ORCID: 0000-0002-5096-3310

Seungsoo Lee

Sungkyunkwan University, Korea (the Republic of)

Woonggyu Choi

Sungkyunkwan University, Korea (the Republic of)

Yuntae Jeon

Sungkyunkwan University, Korea (the Republic of) - ORCID: 0000-0002-1777-5297

Dai Quoc Tran

Sungkyunkwan University, Korea (the Republic of) - ORCID: 0000-0003-2652-821X

Seunghee Park

Sungkyunkwan University, Korea (the Republic of) - ORCID: 0000-0001-8970-0668

  1. Costin, A., Pradhananga, N., & Teizer, J. (2012). Leveraging passive RFID technology for construction resource field mobility and status monitoring in a high-rise renovation project. Automation in Construction, 24, 1-15.
  2. Golparvar-Fard, M., Heydarian, A., & Niebles, J. C. (2013). Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers. Advanced Engineering Informatics, 27(4), 652-663.
  3. Guo, M. H., Xu, T. X., Liu, J. J., Liu, Z. N., Jiang, P. T., Mu, T. J., ... & Hu, S. M. (2022). Attention mechanisms in computer vision: A survey. Computational visual media, 8(3), 331-368.
  4. Helander, M. (1980). Safety challenges in the construction industry. Journal of Occupational Accidents, 2(4), 257-263.
  5. Hu, J., Shen, L., & Sun, G. (2018). Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 7132-7141.
  6. Jeon, Y., Tran, D. Q., Park, M., & Park, S. (2023). Leveraging Future Trajectory Prediction for Multi-Camera People Tracking. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 5398-5407.
  7. Maji, D., Nagori, S., Mathew, M., & Poddar, D. (2022). Yolo-pose: Enhancing yolo for multi person pose estimation using object keypoint similarity loss. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2637-2646.
  8. Park, M., Tran, D. Q., Dai. Bak, J., & Park, S. (2023). Small and overlapping worker detection at construction sites. Automation in Construction, 151, 104856.
  9. Park, M., Tran, D. Q., Jung, D., & Park, S. (2020). Wildfire-detection method using DenseNet and CycleGAN data augmentation-based remote camera imagery. Remote Sensing, 12(22), 3715.
  10. Park, M., Tran, D. Q., Bak, J., & Park, S. (2022). Advanced wildfire detection using generative adversarial network-based augmented datasets and weakly supervised object localization. International Journal of Applied Earth Observation and Geoinformation, 114, 103052.
  11. Pradhananga, N., & Teizer, J. (2013). Automatic spatio-temporal analysis of construction site equipment operations using GPS data. Automation in construction, 29, 107-122.
  12. Rafindadi, A. D. U., Napiah, M., Othman, I., Mikić, M., Haruna, A., Alarifi, H., & Al-Ashmori, Y. Y. (2022). Analysis of the causes and preventive measures of fatal fall-related accidents in the construction industry. Ain Shams Engineering Journal, 13(4), 101712.
  13. Ranftl, R., Bochkovskiy, A., & Koltun, V. (2021). Vision transformers for dense prediction. In Proceedings of the IEEE/CVF international conference on computer vision, 12179-12188.
  14. Tran, D. Q., Park, M., Jeon, Y., Bak, J., & Park, S. (2022). Forest-fire response system using deep-learning-based approaches with CCTV images and weather data. IEEE Access, 10, 66061-66071.
  15. Wang, C. Y., Bochkovskiy, A., & Liao, H. Y. M. (2023). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 7464-7475.
  16. Woo, S., Park, J., Lee, J. Y., & Kweon, I. S. (2018). Cbam: Convolutional block attention module. In Proceedings of the European conference on computer vision (ECCV), 3-19.
  17. Zhang, M., & Fang, D. (2013). A cognitive analysis of why Chinese scaffolders do not use safety harnesses in construction. Construction Management and Economics, 31(3), 207-222.
PDF
  • Publication Year: 2023
  • Pages: 634-640

XML
  • Publication Year: 2023

Chapter Information

Chapter Title

Deep Learning-Based Pose Estimation for Identifying Potential Fall Hazards of Construction Worker

Authors

Minsoo Park, Seungsoo Lee, Woonggyu Choi, Yuntae Jeon, Dai Quoc Tran, Seunghee Park

DOI

10.36253/979-12-215-0289-3.62

Peer Reviewed

Publication Year

2023

Copyright Information

© 2023 Author(s)

Content License

CC BY-NC 4.0

Metadata License

CC0 1.0

Bibliographic Information

Book Title

CONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality

Book Subtitle

Managing the Digital Transformation of Construction Industry

Editors

Pietro Capone, Vito Getuli, Farzad Pour Rahimian, Nashwan Dawood, Alessandro Bruttini, Tommaso Sorbi

Peer Reviewed

Publication Year

2023

Copyright Information

© 2023 Author(s)

Content License

CC BY-NC 4.0

Metadata License

CC0 1.0

Publisher Name

Firenze University Press

DOI

10.36253/979-12-215-0289-3

eISBN (pdf)

979-12-215-0289-3

eISBN (xml)

979-12-215-0257-2

Series Title

Proceedings e report

Series ISSN

2704-601X

Series E-ISSN

2704-5846

145

Fulltext
downloads

118

Views

Export Citation

1,340

Open Access Books

in the Catalogue

2,191

Book Chapters

3,790,127

Fulltext
downloads

4,399

Authors

from 923 Research Institutions

of 65 Nations

64

scientific boards

from 348 Research Institutions

of 43 Nations

1,246

Referees

from 379 Research Institutions

of 38 Nations