ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume X-4-2024
https://doi.org/10.5194/isprs-annals-X-4-2024-501-2024
https://doi.org/10.5194/isprs-annals-X-4-2024-501-2024
18 Oct 2024
 | 18 Oct 2024

NeRF-based Localization and Meshing with Wearable Laser Scanning System: A Case Study in Underground Environment

Yizhe Zhang, Jianping Li, Xin Zhao, Youqi Liao, Zhen Dong, and Bisheng Yang

Keywords: NeRF, SLAM, Underground, Meshing, Wearable Sensing

Abstract. Due to the subterranean scene’s poor lighting conditions and variability of the environment, real-time localizing and meshing in complex underground scenes present a challenging task, with high-potential applications in mining and tunnel protection. In this work, we propose a method that combines SLAM and NeRF for mesh reconstruction in the underground environment with a wearable device. First, a LiDAR-Inertial odometry is used for pose estimation. The resulting poses and sequential laser frames are synchronized to generate a novel data structure, scan-block, which is crucial for improving efficiency and ensuring local precision. This structure is designed to enhance efficiency and ensure local precision. Finally, the generated scan-blocks are passed to the backend NeRF for real-time mesh reconstruction. The experiments are carried out in a complex underground space. The experimental results proved that this method achieved good results. The demo video can be found at https://youtu.be/_y1vbaW06EM?si= hFnAl12u-ffU933h.