- CONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality
- Edited by Pietro Capone, Vito Getuli, Farzad Pour Rahimian, Nashwan Dawood, Alessandro Bruttini, Tommaso Sorbi
As-Built Detection of Structures by the Segmentation of Three-Dimensional Models and Point Cloud Data
- Nobuyoshi Yabuki
- Tomohiro Fukuda
- Ryu Izutsu
- © 2023 Author(s) |
- CC BY-NC 4.0
- DOI: 10.36253/979-12-215-0289-3.111
At construction sites, as-built management is generally conducted by taking pictures or surveying with total stations and comparing the images or survey data with design drawings or Building Information Modeling (BIM) models. Since this work is time-consuming and error-prone, more efficient and accurate methods using advanced Information and Communication Technology (ICT) are desired. Therefore, this research proposes a method that can efficiently capture the progress of construction by detecting each constructed structural member, such as beams, columns, connections, etc. In this proposed method, construction engineers first take many pictures of the construction site and conduct automatic image segmentation using a pre-trained Convolutional Neural Network (CNN) model. Next, point cloud data is generated from taken pictures by using Structure from Motion (SfM). Then, the point cloud data is semantically segmented by overlapping the segmented images and point cloud data using the pin-hole camera technique. Finally, the design BIM model and segmented point cloud data are overlapped, and constructed parts of the BIM model can be detected, which can be reported as as-built parts. A prototype system was developed and applied to an actual railway construction project in Osaka, Japan for testing the accuracy and performance of the system
- Keywords:
- Construction progress management,
- Instance segmentation,
- Point cloud,
- Building Information Modeling.,
Osaka University, Japan - ORCID: 0000-0002-2944-4540
Osaka University, Japan - ORCID: 0000-0002-4271-4445
Kajima Corporation, Japan
- Bosche, F., Haas, C. T., & Akinci, B. (2009). Automated recognition of 3D CAD objects in site laser scans for project 3D status visualization and performance control. Journal of Computing in Civil Engineering, 23(6), 311-318. DOI: 10.1061/(ASCE)0887-3801(2009)23:6(311)
- Brilakis, I., Lourakis, M., Sacks, R., Savarese, S., Christodoulou, S., Teizer, J., & Makhmalbaf, A. (2010). Toward the automated generation of parametric BIMs based on hybrid video and laser scanning data. Advanced Engineering Informatics, 24(4), 456-465. DOI: 10.1016/j.aei.2010.06.006
- Charles, R. Q., Su, H., Mo, K., & Guibas, L. J. (2017). PointNet: Deep learing on Point Sets for 3D Classification and Segmentation. IEEE Conference on Computer Vision and Pattern Recognition, DOI: 10.1109/CVPR.2017.16
- Fathi, H., Dai, F., & Lourakis, M. (2015). Automated as-built 3D reconstruction of civil infrastructure using computer vision: Achievements, opportunities, and challenges. Advanced Engineering Informatics, 29(2), 149-161. DOI: 10.1016/j.aei.2015.01.012
- Gidaris, S., & Komodakis, N. (2015). Object detection via a multi-region and semantic segmentation-aware CNN model. In Proceedings of the IEEE International Conference on Computer Vision, 1134-1142. DOI: 10.48550/arXiv.1505.01749
- Hamledari, H., McCabe, B., & Davari, S. (2017). Automated computer vision-based detection of components of under-construction indoor partitions. Automation in Construction, 74, 78-94. DOI: 10.1016/j.autcon.2016.11.009
- Khaloo, A., & Lattanzi, D. (2015). Extracting structural models through computer vision. In Structures Congress 2015, 538-548.
- Kropp, C., Koch, C., & König, M. (2018). Interior construction state recognition with 4D BIM registered image sequences. Automation in Construction, 86, 11-32. DOI: 10.1016/j.autcon.2017.10.027
- Lu, R., Brilakis, I., & Middleton, C. R. (2019). Detection of structural components in point clouds of existing RC bridges. Computer-Aided Civil and Infrastructure Engineering, 34(3), 191-212. DOI: 10.1111/mice.12407
- Pan, Y., Braun, A., Brilakis, I., & Borrmann, A. (2022). Enriching geometric digital twins of buildings with small objects by fusing laser scanning and AI-based image recognition. Automation in Construction, 140, 104375. DOI: 10.1016/j.autcon.2022.104375
- Park, J., Cai, H., & Perissin, D. (2018). Bringing information to the field: automated photo registration and 4D BIM. Journal of Computing in Civil Engineering, 32(2), 04017084. DOI: 10.1061/(ASCE)CP.1943-5487.0000740
- Perez-Perez, Y., Golparvar-Fard, M., & El-Rayes, K. (2021). Segmentation of point clouds via joint semantic and geometric features for 3D modeling of the built environment. Automation in Construction, 125, 103584. DOI: 10.1016/j.autcon.2021.103584
- Tang, P., Huber, D., Akinci, B., Lipman, R., & Lytle, A. (2010). Automatic reconstruction of as-built building information models from laser-scanned point clouds: A review of related techniques. Automation in Construction, 19(7), 829-843. DOI: 10.1016/j.autcon.2010.06.007
- Cityscapes Dataset: Semantic Understanding of Urban Street Scenes. (n.d.). Retrieved May 19, 2023, from https://www.cityscapes-dataset.com/
Chapter Information
Chapter Title
As-Built Detection of Structures by the Segmentation of Three-Dimensional Models and Point Cloud Data
Authors
Nobuyoshi Yabuki, Tomohiro Fukuda, Ryu Izutsu
DOI
10.36253/979-12-215-0289-3.111
Peer Reviewed
Publication Year
2023
Copyright Information
© 2023 Author(s)
Content License
Metadata License
Bibliographic Information
Book Title
CONVR 2023 - Proceedings of the 23rd International Conference on Construction Applications of Virtual Reality
Book Subtitle
Managing the Digital Transformation of Construction Industry
Editors
Pietro Capone, Vito Getuli, Farzad Pour Rahimian, Nashwan Dawood, Alessandro Bruttini, Tommaso Sorbi
Peer Reviewed
Publication Year
2023
Copyright Information
© 2023 Author(s)
Content License
Metadata License
Publisher Name
Firenze University Press
DOI
10.36253/979-12-215-0289-3
eISBN (pdf)
979-12-215-0289-3
eISBN (xml)
979-12-215-0257-2
Series Title
Proceedings e report
Series ISSN
2704-601X
Series E-ISSN
2704-5846