A deep learning-based method for the intelligent identification of the quantity of coals flushed out during borehole hydraulic flushing

Authors

LI Xiaojun, School of Energy Science and Engineering, Henan Polytechnic University, Jiaozuo 454003, China; Henan International Joint Laboratory of Coalmine Ground Control, Jiaozuo 454003, ChinaFollow
ZHAO Mingyang, School of Energy Science and Engineering, Henan Polytechnic University, Jiaozuo 454003, China; School of Innovation and Entrepreneurship, Henan Polytechnic University, Jiaozuo 454003, ChinaFollow
LI Miao, School of Energy Science and Engineering, Henan Polytechnic University, Jiaozuo 454003, China; School of Innovation and Entrepreneurship, Henan Polytechnic University, Jiaozuo 454003, China

Abstract

Objective Given the inaccurate and low-efficiency manual statistics of the quantity of coals flushed out during borehole hydraulic flushing, this study proposed an intelligent identification method that combines YOLOv8n, ResNet34, and PP-OCRv4 algorithms. Methods First, the first-level detection was completed using the YOLOv8n algorithm, which, combined with the ResNet34 and PP-OCRv4 algorithms via parallel cascade, was then employed to conduct second-level processing. Through the above processing and in combination with the method for classification status discrimination based on tracking frame numbers, the framework of an algorithm for automatically calculating the quantity of coals flushed out was established. Subsequently, the deformable convolution DCNv2 module was introduced into the C2f module of YOLOv8n to reduce the impacts of point-like strong illumination on feature extraction. Moreover, the default detection head of YOLOv8n was replaced with the Dynamic Head module to strengthen the feature extraction in scale, space, and channel dimensions. The CIoU loss function was replaced with the SIoU loss function to accelerate the matching between prediction and ground truth boxes. Finally, the improved YOLOv8n algorithm was validated using a self-built dataset. Results and Conclusions The results indicate that, compared to the original algorithm, the improved YOLOv8n algorithm increased the mean average classification accuracy, recall, and precision by 7.6%, 3.5%, and 6.4%, respectively. This verifies the effectiveness and stability of the improvement strategy for enhancing the model performance. The improved YOLOv8n algorithm was applied to the real-time videos from four drilling sites of borehole hydraulic flushing for gas drainage, yielding respective identification accuracies of 100.0%, 93.3%, 95.7%, and 93.1%, with an average of 95.5%, meeting the accuracy requirements for the automatic identification of coal quantity flushed out during borehole hydraulic flushing. The method for determining the ResNet34 classification status based on tracking frame numbers resolved the problem of unreliable single identification of the classification status. The results of this study provide a technical and practical foundation for the integration of the YOLO series of algorithms with other deep learning techniques and its wide applications. Besides, these results serve as a valuable reference for achieving intelligent advances in complex underground coal mine scenarios such as drilling sites for gas drainage.

Keywords

gas drainage, quantity of coals flushed out, YOLOv8n, ResNet34, PaddleOCR, deformable convolution, Dynamic Head (DyHead), intelligent identification, coal mine

DOI

10.12363/issn.1001-1986.24.09.0605

Recommended Citation

LI Xiaojun, ZHAO Mingyang, LI Miao, et al. (2025) "A deep learning-based method for the intelligent identification of the quantity of coals flushed out during borehole hydraulic flushing," Coal Geology & Exploration: Vol. 53: Iss. 1, Article 22.
DOI: 10.12363/issn.1001-1986.24.09.0605
Available at: https://cge.researchcommons.org/journal/vol53/iss1/22

Reference

[1] 刘晓，李勇，宣德全，等. 软煤夹层水射流层状卸压增透抽采瓦斯数值模拟及试验[J]. 煤田地质与勘探，2021，49(2)：54−61.

LIU Xiao，LI Yong，XUAN Dequan，et al. Numerical simulation and test of gas drainage with water jet layered pressure relief and permeability enhancement in soft coal seam[J]. Coal Geology & Exploration，2021，49(2)：54−61.

[2] 卢义玉，黄杉，葛兆龙，等. 我国煤矿水射流卸压增透技术进展与战略思考[J]. 煤炭学报，2022，47(9)：3189−3211.

LU Yiyu，HUANG Shan，GE Zhaolong，et al. Research progress and strategic thinking of coal mine water jet technology to enhance coal permeability in China[J]. Journal of China Coal Society，2022，47(9)：3189−3211.

[3] 谷保泽. 五虎山煤矿水力造穴增透物理模拟及钻孔优化设计[J]. 煤矿安全，2024，55(7)：15−21.

GU Baoze. Physical simulation and drilling optimization design of hydraulic cavitation and permeability enhancement in Wuhushan Coal Mine[J]. Safety in Coal Mines，2024，55(7)：15−21.

[4] 任培良，刘彦伟，韩红凯，等. 冲煤率对煤层卸压增透及瓦斯抽采的影响规律研究[J]. 煤炭科学技术，2022，50(10)：102−109.

REN Peiliang，LIU Yanwei，HAN Hongkai，et al. Study on influence laws of coal flushing rate on coal seam stress relief and gas extraction[J]. Coal Science and Technology，2022，50(10)：102−109.

[5] 刘厅，林柏泉，赵洋，等. 瓦斯非均衡赋存煤层精准冲孔增透技术及应用[J]. 煤炭科学技术，2023，51(2)：217−231.

LIU Ting，LIN Baiquan，ZHAO Yang，et al. Precise permeability enhancement technique with hydraulic flushing for coal seams with non-uniformly distributed gas[J]. Coal Science and Technology，2023，51(2)：217−231.

[6] 张帅. 松软低渗突出煤层水力冲孔卸压增透研究[J]. 煤矿安全，2024，55(3)：66−72.

ZHANG Shuai. Research of pressure relief and permeability improvement of hydraulic punching in soft and low permeability outburst coal seam[J]. Safety in Coal Mines，2024，55(3)：66−72.

[7] 曹佐勇，王恩元，何学秋，等. 近距离突出煤层群水力冲孔卸压瓦斯抽采及效果评价研究[J]. 采矿与安全工程学报，2021，38(3)：634−642.

CAO Zuoyong，WANG Enyuan，HE Xueqiu，et al. Effect evaluation of pressure relief and gas drainage of hydraulic punching in short-distance coal seam group with the risk of outburst[J]. Journal of Mining & Safety Engineering，2021，38(3)：634−642.

[8] 王国法，庞义辉，任怀伟，等. 智慧矿山系统工程及关键技术研究与实践[J]. 煤炭学报，2024，49(1)：181−202.

WANG Guofa，PANG Yihui，REN Huaiwei，et al. System engineering and key technologies research and practice of smart mine[J]. Journal of China Coal Society，2024，49(1)：181−202.

[9] 王国法，张良，李首滨，等. 煤矿无人化智能开采系统理论与技术研发进展[J]. 煤炭学报，2023，48(1)：34−53.

WANG Guofa，ZHANG Liang，LI Shoubin，et al. Progresses in theory and technological development of unmanned smart mining system[J]. Journal of China Coal Society，2023，48(1)：34−53.

[10] 程德强，钱建生，郭星歌，等. 煤矿安全生产视频AI识别关键技术研究综述[J]. 煤炭科学技术，2023，51(2)：349−365.

CHENG Deqiang，QIAN Jiansheng，GUO Xingge，et al. Review on key technologies of AI recognition for videos in coal mine[J]. Coal Science and Technology，2023，51(2)：349−365.

[11] REDMON J，DIVVALA S，GIRSHICK R，et al. You only look once：Unified，real-time object detection[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas，NV，USA. IEEE，2016：779–788.

[12] REDMON J，FARHADI A. YOLOv3：An incremental improvement[EB/OL]. 2018：1804.02767. https://arxiv.org/abs/1804.02767v1.

[13] WANG C Y，BOCHKOVSKIY A，LIAO H Y M. YOLOv7：Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver，BC，Canada. IEEE，2023：7464–7475.

[14] 郝帅，张旭，马旭，等. 基于CBAM-YOLOv5的煤矿输送带异物检测[J]. 煤炭学报，2022，47(11)：4147−4156.

HAO Shuai，ZHANG Xu，MA Xu，et al. Foreign object detection in coal mine conveyor belt based on CBAM-YOLOv5[J]. Journal of China Coal Society，2022，47(11)：4147−4156.

[15] 姜媛媛，刘宋波. 基于改进YOLOv8n的煤矿井下钻杆计数方法[J]. 工矿自动化，2024，50(8)：112−119.

JIANG Yuanyuan，LIU Songbo. A coal mine underground drill pipes counting method based on improved YOLOv8n[J]. Journal of Mine Automation，2024，50(8)：112−119.

[16] 王琦，夏鲁飞，陈天明，等. 基于改进YOLOv8n的井下人员安全帽佩戴检测[J]. 工矿自动化，2024，50(9)：124−129.

WANG Qi，XIA Lufei，CHEN Tianming，et al. Detection of underground personnel safety helmet wearing based on improved YOLOv8n[J]. Journal of Mine Automation，2024，50(9)：124−129.

[17] 路晓亚，李海芳. 低可见度环境下基于改进YOLOv3的井下人员定位方法[J]. 工矿自动化，2024，50(9)：130−137.

LU Xiaoya，LI Haifang. Personnel localization method for low-visibility environments based on improved YOLOv3[J]. Journal of Mine Automation，2024，50(9)：130−137.

[18] 邵小强，李鑫，杨涛，等. 改进YOLOv5s和DeepSORT的井下人员检测及跟踪算法[J]. 煤炭科学技术，2023，51(10)：291−301.

SHAO Xiaoqiang，LI Xin，YANG Tao，et al. Underground personnel detection and tracking based on improved YOLOv5s and DeepSORT[J]. Coal Science and Technology，2023，51(10)：291−301.

[19] 葛庆楠，程刚，赵东洋. 基于KRB-YOLOv5s的煤矸识别方法[J]. 辽宁工程技术大学学报(自然科学版)，2024，43(4)：385−392.

GE Qingnan，CHENG Gang，ZHAO Dongyang. Recognition method for coal and gangue based on KRB-YOLOv5s[J]. Journal of Liaoning Technical University (Natural Science)，2024，43(4)：385−392.

[20] 刘洺睿，车奔，董洪波，等. 露天煤矿采场无人机遥感图像小目标检测[J]. 煤田地质与勘探，2023，51(11)：132−140.

LIU Mingrui，CHE Ben，DONG Hongbo，et al. Detection of small objects in open-pit coal mine stopes using UAV remote sensing images[J]. Coal Geology & Exploration，2023，51(11)：132−140.

[21] 孙传猛，王燕平，王冲，等. 融合改进YOLOv3与三次样条插值的煤岩界面识别方法[J]. 采矿与岩层控制工程学报，2022，4(1)：81−90.

SUN Chuanmeng，WANG Yanping，WANG Chong，et al. Coal-rock interface identification method based on improved YOLOv3 and cubic spline interpolation[J]. Journal of Mining and Strata Control Engineering，2022，4(1)：81−90.

[22] 刘春霞，李超，潘理虎，等. 改进YOLOv5s的煤矿烟火检测算法[J]. 计算机工程与应用，2023，59(17)：286−294.

LIU Chunxia，LI Chao，PAN Lihu，et al. Improved coal mine smoke and fire detection algorithm of YOLOv5s[J]. Computer Engineering and Applications，2023，59(17)：286−294.

[23] 王红尧，韩爽，李勤怡. 改进YOLOv5的钢丝绳损伤图像识别实验方法研究[J]. 计算机工程与应用，2023，59(17)：99−106.

WANG Hongyao，HAN Shuang，LI Qinyi. Experimental research on image recognition of wire rope damage based on improved YOLOv5[J]. Computer Engineering and Applications，2023，59(17)：99−106.

[24] ZHU Xizhou，HU Han，LIN S，et al. Deformable ConvNets V2：More deformable，better results[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach，CA，USA. IEEE，2019：9300–9308.

[25] DAI Xiyang，CHEN Yinpeng，XIAO Bin，et al. Dynamic head：Unifying object detection heads with attentions[C]//2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville，TN，USA. IEEE，2021：7369–7378.

[26] GEVORGYAN Z. SIoU loss：More powerful learning for bounding box regression[EB/OL]. 2022：2205.12740. https://arxiv. org/abs/2205.12740v1

[27] HE Kaiming，ZHANG Xiangyu，REN Shaoqing，et al. Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas，NV，USA. IEEE，2016：770–778.

[28] LIAO Minghui，WAN Zhaoyi，YAO Cong，et al. Real-time scene text detection with differentiable binarization[J]. Proceedings of the AAAI Conference on Artificial Intelligence，2020，34(7)：11474−11481.

[29] HOWARD A，SANDLER M，CHEN Bo，et al. Searching for MobileNetV3[C]//2019 IEEE/CVF International Conference on Computer Vision (ICCV). Seoul，Korea (South). IEEE，2019：1314–1324.

[30] DU Yongkun，CHEN Zhineng，JIA Caiyan，et al. SVTR：Scene text recognition with a single visual model[EB/OL]. 2022：2205.00159. https://arxiv. org/abs/2205.00159v2.

[31] WANG C Y，YEH I H，LIAO H Y M. YOLOv9：Learning what you want to learn using programmable gradient information[EB/OL]. 2024：2402.13616. https://arxiv. org/abs/2402.13616v2.

[32] WANG Ao，CHEN Hui，LIU Lihao，et al. YOLOv10：Real-time end-to-end object detection[EB/OL]. 2024：2405.14458. https://arxiv. org/abs/2405.14458v2.