ISPRS-Annals ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences ISPRS-Annals ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci. 2194-9050 Copernicus Publications Göttingen, Germany 10.5194/isprs-annals-V-2-2021-161-2021 DETECTING CRACKS AND SPALLING AUTOMATICALLY IN EXTREME EVENTS BY END-TO-END DEEP LEARNING FRAMEWORKS Bai Y. 1 Sezen H. 1 Yilmaz A. 1 Dept. of Civil, Environmental and Geodetic Engineering, The Ohio State University, 2070 Neil Avenue, Columbus, Ohio, USA 17 06 2021 V-2-2021 161 168 Copyright: © 2021 Y. Bai et al. 2021 This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/ This article is available from https://isprs-annals.copernicus.org/articles/V-2-2021/161/2021/isprs-annals-V-2-2021-161-2021.html The full text article is available as a PDF file from https://isprs-annals.copernicus.org/articles/V-2-2021/161/2021/isprs-annals-V-2-2021-161-2021.pdf

In this paper, we develop and implement end-to-end deep learning approaches to automatically detect two important types of structural failures, cracks and spalling, of buildings and bridges in extreme events such as major earthquakes. A total of 2,229 images were annotated, and are used to train and validate three newly developed Mask Regional Convolutional Neural Networks (Mask R-CNNs). In addition, three sets of public images for different disasters were used to test the accuracy of these models. For detecting and marking these two types of structural failures, one of proposed methods can achieve an accuracy of 67.6% and 81.1%, respectively, on low- and high-resolution images collected from field investigations. The results demonstrate that it is feasible to use the proposed end-to-end method for automatically locating and segmenting the damage using 2D images which can help human experts in cases of disasters.