Detection of small objects in open-pit coal mine stopes using UAV remote sensing images

Authors

LIU Mingrui, College of Geological Engineering and Geomatics, Chang’an University, Xi’an 710061, ChinaFollow
CHE Ben, Guangzhou Institute of Technology, Xidian University, Guangzhou 510555, China
DONG Hongbo, CCTEG Xi’an Research Institute (Group) Co., Ltd., Xi’an 710077, ChinaFollow
ZHU Ruoli, Department of Economics, Queen’s University, Kingston K7L3N6, Canada

Abstract

Open-pit coal mine stopes witness frequent vehicle accidents due to their complex terrains. Therefore, accurately positioning vehicles in the stopes is critical to safe coal mining. To overcome the inaccurate positioning of small targets in the mining areas using Unmanned aerial vehicle (UAV) remote sensing images, this study proposed an improved YOLOv7 model for object detection. First, to expedite the reasoning of the YOLOv7 network, the ELAN module in the original YOLOv7 model was improved by introducing partial convolution. Based on this, the eSE channel attention mechanism was combined to form the PConv-eSE convolution attention module. The purpose is to enhance the network’s ability to extract the features of small targets and reduce the impact of background information. Finally, the loss function of the Normalized Wasserstein Distance (NWD) metric was used to further optimize the network and improve the accuracy. The improved YOLOv7 model was verified through experiments using a vehicle dataset of a mining area stope. The results show that the P_mav value of the improved YOLOv7 model reached 94.5%, which was 7.2% higher than the original model, thus effectively overcoming the missing of small targets from remote sensing images in the detection using the original network. This study will provide a theoretical basis for the positioning of small objects in an open-pit coal mining area using UAVs.

Keywords

open-pit coal mine, Unmanned aerial vehicle (UAV), remote sensing images of mining area, small object detection, YOLOv7, attention mechanism, Normalized Wasserstein Distance (NWD) metric

DOI

10.12363/issn.1001-1986.23.04.0186

Recommended Citation

LIU Mingrui, CHE Ben, DONG Hongbo, et al. (2023) "Detection of small objects in open-pit coal mine stopes using UAV remote sensing images," Coal Geology & Exploration: Vol. 51: Iss. 11, Article 15.
DOI: 10.12363/issn.1001-1986.23.04.0186
Available at: https://cge.researchcommons.org/journal/vol51/iss11/15

Reference

[1] 王国法，刘峰. 中国煤矿智能化发展报告(2020年) [M]. 北京：科学出版社，2020.

[2] 王昆,杨鹏,吕文生,等. 无人机遥感在矿业领域应用现状及发展态势[J]. 工程科学学报,2020,42(9):1085−1095.

WANG Kun,YANG Peng,LYU Wensheng,et al. Current status and development trend of UAV remote sensing applications in the mining industry[J]. Chinese Journal of Engineering,2020,42(9):1085−1095.

[3] 程健,叶亮,郭一楠,等. 采空区地裂缝混合域注意力变形卷积网络检测方法[J]. 煤炭学报,2020,45(增刊2):993−1002.

CHENG Jian,YE Liang,GUO Yinan,et al. An aerial image detection method of ground crack in goaf based on deformable convolutional network with hybrid domain attention[J]. Journal of China Coal Society,2020,45(Sup.2):993−1002.

[4] 秦晓辉,黄启东,常灯祥,等. 基于改进YOLOv5的露天矿山目标检测方法[J]. 湖南大学学报(自然科学版),2023,50(2):23−30.

QIN Xiaohui,HUANG Qidong,CHANG Dengxiang,et al. Object detection method in open−pit mine based on improved YOLOv5[J]. Journal of Hunan University (Natural Sciences),2023,50(2):23−30.

[5] 薛雅丽,孙瑜,马瀚融. 航空遥感影像中的轻量级小目标检测[J]. 电光与控制,2022,29(6):11−15.

XUE Yali,SUN Yu,MA Hanrong. Lightweight small target detection in aerial remote sensing image[J]. Electronics Optics & Control,2022,29(6):11−15.

[6] WEI Zhiwei，DUAN Chengzhen，SONG Xinghao，et al. Amrnet：Chip augmentation in aerial image object detection[J]. ArXiv Preprint ArXiv，2020. DOI：10.48550/arXiv.2009.07168.

[7] YIN Ruihong,ZHAO Wei,FAN Xudong,et al. AF–SSD:An accurate and fast single shot detector for high spatial remote sensing imagery[J]. Sensors,2020,20(22):6530.

[8] ZAND M,ETEMAD A,GREENSPAN M. Oriented bounding boxes for small and freely rotated objects[J]. IEEE Transactions on Geoscience and Remote Sensing,2020,60:4701715.

[9] KIM M,JEONG J,KIM S. ECAP–YOLO:Efficient channel attention pyramid YOLO for small object detection in aerial image[J]. Remote Sensing,2021,13(23):4851.

[10] REDMON J，FARHADI A. YOLOv3：An incremental improvement[J]. ArXiv Preprint ArXiv，2018. DOI：10.48550/arXiv.1804. 02767.

[11] WU Jingqian,XU Shibiao. From point to region:Accurate and efficient hierarchical small object detection in low–resolution remote sensing images[J]. Remote Sensing,2021,13(13):2620.

[12] RAN Qiong,WANG Qing,ZHAO Boya,et al. Lightweight oriented object detection using multiscale context and enhanced channel attention in remote sensing images[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2021,14:5786−5795.

[13] WANG C Y，BOCHKOVSKIY A，LIAO H Y M. YOLOv7：Trainable bag–of–freebies sets new state–of–the–art for real–time object detectors[J]. arXiv preprint arXiv，2022. DOI：10.48550/arXiv.2207. 02696.

[14] GIRSHICK R，DONAHUE J，DARRELL T，et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus，2014：580–587.

[15] GIRSHICK R. Fast R–CNN[C]//Proceedings of the IEEE International Conference on Computer Vision. Santiago，2015：1440–1448.

[16] REN Shaoqing,HE Kaiming,GIRSHICK R,et al. Faster R–CNN:Towards real–time object detection with region proposal networks[J]. Advances in Neural Information Processing Systems,2015,28:1−14.

[17] 邵延华,张铎,楚红雨,等. 基于深度学习的YOLO目标检测综述[J]. 电子与信息学报,2022,44(10):3697−3708.

SHAO Yanhua,ZHANG Duo,CHU Hongyu,et al. A review of YOLO object detection based on deep learning[J]. Journal of Electronics & Information Technology,2022,44(10):3697−3708.

[18] LIU Wei，ANGUELOV D，ERHAN D，et al. SSD：Single shot multibox detector[C]//Computer Vision–ECCV 14th European Conference. Amsterdam，2016：21–37.

[19] LEE Y，PARK J. CenterMask：Real–time anchor–free instance segmentation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Virtual，2020：13906–13915.

[20] CHEN Jierun，KAO S，HE Hao，et al. Run，don’t walk：Chasing higher FLOPS for faster neural networks[J]. ArXiv Preprint ArXiv，2023. DOI：10.48550/arXiv.2303.3667.

[21] YU Jiahui，JIANG Yuning，WANG Zhangyang，et al. UnitBox：An advanced object detection network[C]//4th ACM International Conference on Multimedia. Amsterdam，2016：516−520.

[22] WANG J，XU C，YANG W，et al. A normalized Gaussian Wasserstein distance for tiny object detection[J]. ArXiv Preprint ArXiv，2021. DOI：10.48550/arXiv.2110.13389.

[23] HU Jie,SHEN Li,ALBANIE S,et al. Squeeze-and-excitation networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2020,48(2):2011−2023.