ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume VIII-M-1-2021
https://doi.org/10.5194/isprs-annals-VIII-M-1-2021-155-2021
https://doi.org/10.5194/isprs-annals-VIII-M-1-2021-155-2021
27 Aug 2021
 | 27 Aug 2021

3D SURVEYING, SEMANTIC ENRICHMENT AND VIRTUAL ACCESS OF LARGE CULTURAL HERITAGE

S. Teruggi, E. Grilli, F. Fassi, and F. Remondino

Keywords: 3D Point cloud, 3D classification, Augmented Reality, Mixed Reality, HoloLens

Abstract. In recent years, Artificial Intelligence (AI) methods for 3D point cloud classification has assumed an essential role in the heritage field. The association of semantic information to 3D representations became a valuable instrument for measurement, analysis, education or maintenance, in particular in the Cultural Heritage (CH) sector. Moreover, the recent availability and reliability of head-mounted displays and glasses are allowing extraordinary immersive virtual experiences. This paper presents an end-to-end framework to handle large and complex 3D point clouds, from acquisition to semantic segmentation and final access in a Mixed Reality (MR) environment. Three completely different heritage scenarios are considered: the Temple of Neptune in Paestum, the Milan Cathedral and a large portion of Bologna’s porticoes. Mixed Reality experiences are described and shown based on the Microsoft HoloLens 2 device. A video of the results is available at https://youtu.be/Kd_3s0tIX04.