EXTRACTION OF PAINT LOSS IN ANCIENT MURALS BASED ON 3D RESIDUAL NEURAL NETWORK

Abstract. The ancient murals of Qutan Temple in Qinghai Province have a very serious loss of paint. Moreover, the main components of the base color paint layer in the paint loss area and the white patterns in the murals are both calcified, which are similar in color and spectral features. Thus, it is difficult to distinguish them by only using spectral features. A method of paint loss area extraction based on 3D residual network with multi-scale feature fusion is proposed. Firstly, the hyperspectral images with paint loss regions were collected by hyperspectral images. They are pre-processed to establish the training data set. Secondly, 3D residual network models are constructed using 3×3×3, 3×3×5 and 5×5×3 convolution kernels to realize the extraction and fusion of spatial and spectral features at different scales of hyperspectral images. The produced mural hyperspectral dataset is used for network training to obtain the prediction model. Finally, the hyperspectral images are input into the trained model to achieve the extraction of paint loss. After comparing different methods, the experimental result shows that the proposed method can improve the extraction accuracy of mural paint loss and serve as a reference for other deteriorations extraction.