3D model reconstruction of large-diameter rescue well based on depth camera

Authors

GU Hairong, National Engineering Research Center of Highway Maintenance Equipment, Chang’an University, Xi’an 710064, ChinaFollow
LUO Jia, National Engineering Research Center of Highway Maintenance Equipment, Chang’an University, Xi’an 710064, China
GAO Ziyu, National Engineering Research Center of Highway Maintenance Equipment, Chang’an University, Xi’an 710064, China
YANG Wenjuan, School of Water Conservancy and Environment, Chang’an University, Xi’an 710064, ChinaFollow
HAN Shuai, National Engineering Research Center of Highway Maintenance Equipment, Chang’an University, Xi’an 710064, China

Abstract

Large-diameter borehole rescue is an effective emergency rescue method for mine disasters. Through the large-diameter rescue well that is constructed to the place where the trapped personnel is located, the trapped personnel can be lifted safely and reliably to the ground by a hoisting capsule. The structural parameters of a large-diameter rescue well and their changes have significant impact on the passing performance of the hoisting capsule. The real-time acquisition of the structural parameters of large-diameter rescue well is the basis of scientific operation and decision-making of large-diameter borehole rescue. In order to satisfy the requirements for monitoring of the structural parameters of large-diameter rescue well, the structural parameter detection and 3D model reconstruction system of large-diameter rescue well was developed based on the Interl RealSense D435i depth camera in the principle of binocular structured light and ROS operation system. To solve the problem that the texture of large-diameter rescue well is smooth and not noticeable, the SIFT, SURF and ORB algorithms were compared and analyzed in terms of the borehole image feature point extraction effect of large-diameter rescue well. Besides, the pose of depth camera was estimated with the ICP-PNP algorithm, and the key frames were screened according to the motion errors between adjacent frames, so as to optimize the 3D point cloud model. Finally, the 3D remodeling test of the large-diameter rescue well was carried out based on the simulation test platform of the lifting process in the large-diameter rescue well. The research results show that: The SURF algorithm has better effect on feature point extraction in the same time when the wellbore texture is not noticeable. The 3D model of large-diameter rescue well can be constructed stably by screening the key frame images according to the motion errors between adjacent frames. The cross-section sampling was performed on the 3D point cloud model of the large-diameter rescue well, showing that the error is within 2% from the actual wellbore radius. In addition, the sampled section of the 3D point cloud model of the large-diameter rescue well was fitted to the circle with the least square circle method, which indicates the error between the fitted circle and the actual wellbore radius is less than 0.4%. The reconstructed 3D model of large-diameter rescue well could accurately reflect the structural parameters of the actual large-diameter rescue well and guarantee the scientific operation and decision-making of surface emergency rescue lifting.

Keywords

large-diameter rescue well, 3D model reconstruction, depth camera, deformation detection

DOI

10.12363/issn.1001-1986.22.10.0765

Recommended Citation

GU Hairong, LUO Jia, GAO Ziyu, et al. (2023) "3D model reconstruction of large-diameter rescue well based on depth camera," Coal Geology & Exploration: Vol. 51: Iss. 5, Article 20.
DOI: 10.12363/issn.1001-1986.22.10.0765
Available at: https://cge.researchcommons.org/journal/vol51/iss5/20

Reference

[1] 田宏亮,邹祖杰,郝世俊,等. 矿山灾害生命保障救援通道快速安全构建关键技术与装备[J]. 煤田地质与勘探,2022,50(11):1−13.

TIAN Hongliang,ZOU Zujie,HAO Shijun,et al. Key technologies and equipment of quickly and safely building life support and rescue channel in mine disaster[J]. Coal Geology & Exploration,2022,50(11):1−13.

[2] 顾海荣,单增海,王龙鹏,等. 大直径钻孔救援提升装备研究进展[J]. 煤田地质与勘探,2022,50(11):45−57.

GU Hairong,SHAN Zenghai,WANG Longpeng,et al. Research progress of lifting equipment for large−diameter borehole rescue[J]. Coal Geology & Exploration,2022,50(11):45−57.

[3] 张文泉,张永双,席京德,等. 煤矿立井井壁破裂的机制及防治措施[J]. 中国地质灾害与防治学报,2001,12(4):13−17.

ZHANG Wenquan,ZHANG Yongshuang,XI Jingde,et al. The mechanism of sidewall cracking in vertical well of coal mine and its prevention countermeasures[J]. The Chinese Journal of Geological Hazard and Control,2001,12(4):13−17.

[4] 田彦强. 矿井事故垂直救援孔快速钻进技术研究[C]//第二十一届全国探矿工程 (岩土钻掘工程)学术交流年会论文集. 北京：地质出版社，2021：211–215.

[5] BAKER C，MORRIS A C，FERGUSON D，et al. A campaign in autonomous mine mapping[C]//IEEE International Conference on Robotics and Automation. New Orleans，2004：122–127.

[6] RAVAL S，BANERJEE B，CANBULAT I，et al. A preliminary investigation of mobile mapping technology for underground mining[C]//International Geoscience and Remote Sensing Symposium (IGARSS). Yokohama，2019：188–195.

[7] JASKOWSKI W. Modular measurement system for mine shaft inventory[J]. Archives of Mining Sciences,2010,55(1):81−90.

[8] KRISADA C. Damage detection and monitoring for tunnel inspection based on computer vision[D]. Cambridge：University of Cambridge，2014.

[9] 陈凯,杨小聪,张达. 采空区三维激光扫描变形监测系统[J]. 矿冶,2012,21(1):60−63.

CHEN Kai,YANG Xiaocong,ZHANG Da. 3D laser scanning deformation monitoring system to the cavity[J]. Mining & Metallurgy,2012,21(1):60−63.

[10] 李斌,王太元. 光纤光栅技术在竖井井筒监测中的应用[J]. 中州煤炭,2016,24(8):75−78.

LI Bin,WANG Taiyuan. Application of fiber bragg grating technology in vertical shaft monitoring[J]. Zhongzhou Coal,2016,24(8):75−78.

[11] 查剑林. 井筒内壁成图系统关键技术研究[D]. 徐州：中国矿业大学，2015.

ZHA Jianlin. Study on the key technology for shaft wall mapping system[D]. Xuzhou：China University of Mining and Technology，2015.

[12] 王海军,刘再斌,雷晓荣,等. 煤矿巷道三维激光扫描关键技术及工程实践[J]. 煤田地质与勘探,2022,50(1):109−117.

WANG Haijun,LIU Zaibin,LEI Xiaorong,et al. Key technologies and engineering practice of 3D laser scanning in coal mine roadways[J]. Coal Geology & Exploration,2022,50(1):109−117.

[13] 刘三毛,朱文球,孙文静,等. 基于RGB–D单目视觉的室内场景三维重建[J]. 微型机与应用,2017,36(1):44−47.

LIU Sanmao,ZHU Wenqiu,SUN Wenjing,et al. 3D reconstruction of indoor scenes using RGB–D monocular vision[J]. Microcomputers & its Applications,2017,36(1):44−47.

[14] 沈彤,刘文波,王京. 基于双目立体视觉的目标测距系统[J]. 电子测量技术,2015,38(4):52−54.

SHEN Tong,LIU Wenbo,WANG Jing. Distance measurement system based on binocular stereo vision[J]. Electronic Measurement Technology,2015,38(4):52−54.

[15] 陈亦麟,王发宇,刘建阳. 基于双目立体视觉与结构光的便携式非接触三维掌纹采集系统[J]. 激光与光电子学进展,2022,59(4):0410016.

CHEN Yilin,WANG Fayu,LIU Jianyang. Non–contact portable three–dimensional palmprint acquisition system based on binocular stereo vision and structured light[J]. Laser & Optoelectronics Progress,2022,59(4):0410016.

[16] 马骙骙,杨新文,张昭,等. 基于结构光视觉的钢轨波磨检测与定位方法研究[J]. 机械工程学报,2022,58(22):140−147.

MA Kuikui,YANG Xinwen,ZHANG Zhao,et al. Research on detection and positioning method of rail corrugation based on structural light vision[J]. Journal of Mechanical Engineering,2022,58(22):140−147.

[17] 常高祥,刘大明. 基于单目图像的三维重建算法实现[J]. 上海电力大学学报,2021,37(6):577−581.

CHANG Gaoxiang,LIU Daming. Implementation of 3D reconstruction algorithm based on monocular image[J]. Journal of Shanghai University of Electric Power,2021,37(6):577−581.

[18] LIANG Bin,ZHANG Jinyi,TANG Dikai. Fast iterative closest point–simultaneous localization and mapping (ICP–SLAM) with rough alignment and narrowing–scale nearby searching[J]. Journal of Donghua University (English Edition),2017,34(4):583−590.

[19] 吴福朝,胡占义. PnP问题的线性求解算法[J]. 软件学报,2003,14(3):682−688.

WU Fuchao,HU Zhanyi. A linear method for the PnP problem[J]. Journal of Software,2003,14(3):682−688.

[20] 吴旭,卢凌雯,梁栋栋,等. 基于点云数据的曲面重建算法比较研究[J]. 安徽师范大学学报 (自然科学版),2019,42(1):46−50.

WU Xu,LU Lingwen,LIANG Dongdong,et al. Comparison of surface reconstruction algorithms based on point cloud data[J]. Journal of Anhui Normal University (Natural Science),2019,42(1):46−50.