Research on low illumination video enhancement technology in coal mine heading face

Authors

ZHANG Xuhui, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China;Shaanxi Key Laboratoty of Mine Electromechanical Equipment Intelligenct Monitoring, Xi’an 710054, ChinaFollow
YANG Hongqiang, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China
BAI Linna, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China
SHI Shuo, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China
DU Yuyang, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China; Shaanxi Key Laboratoty of Mine Electromechanical Equipment Intelligenct Monitoring, Xi’an 710054, China
ZHANG Chao, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China
WAN Jicheng, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China
YANG Wenjuan, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China; Shaanxi Key Laboratoty of Mine Electromechanical Equipment Intelligenct Monitoring, Xi’an 710054, China
MAO Qinghua
DONG Zheng, College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, China

Abstract

Aiming at overcoming low illumination, uneven brightness, blurry texture and more noise in the video of coal mine heading face, a low illumination video enhancement algorithm was proposed for coal mine heading face. Firstly,the separability of convolution was utilized to carry out one-dimensional horizontal and vertical convolution of video images, then the perfect reflection method was used to achieve the automatic white balance, and the image hybrid enhancement technology was utilized to improve the overall brightness of the video images. Then, the image was divided into the highlight area, the middle tone area and the dark tone area by recursive segmentation based on the atmospheric scattering model and the dark channel prior method, and the maximum channel pixel of the corresponding interval was obtained. Besides, the mean value of the three maximum pixel values was taken as the estimation value of atmospheric illumination, and the transmittance was adjusted and optimized by introducing the adjustment factor. Meanwhile, the Laplacian sharpening process was used to increase the high frequency component and suppress the low frequency componentof the image to increase the image contrast. Finally, the low-illumination video of heading face was dehazed based on the improved atmospheric scattering model. The experimental results show that the proposed video enhancement algorithm could enhance and dehaze the low-illumination video of coal mine heading face in real time, which avoids the problems of dimness, distortion, blurring and mutation of video images. Compared with Retinex algorithm, ALTM algorithm and dark channel prior algorithm, the proposed video enhancement algorithm significantly improves the information entropy, standard deviation and average gradient of the video image, and has a higher real-time processing speed,which can provide high-quality and reliable support for subsequent processings such as video target recognition, target tracking, target monitoring and image segmentation of heading face video.

Keywords

heading face, low illumination, perfect reflection method, atmospheric scattering model, video enhancement, Laplacian sharpening; coal mine

DOI

10.12363/issn.1001-1986.22.09.0689

Recommended Citation

ZHANG Xuhui, YANG Hongqiang, BAI Linna, et al. (2023) "Research on low illumination video enhancement technology in coal mine heading face," Coal Geology & Exploration: Vol. 51: Iss. 1, Article 5.
DOI: 10.12363/issn.1001-1986.22.09.0689
Available at: https://cge.researchcommons.org/journal/vol51/iss1/5

Reference

1.王国法. 加快煤矿智能化建设 推进煤炭行业高质量发展[J]. 中 国煤炭，2021，47(1)：2-10.

WANG Guofa. Speeding up intelligent construction of coal mine and promoting high-quality development of coal industry[J]. China Coal，2021，47(1)：2-10.

2.王国法，任怀伟，赵国瑞，等. 煤矿智能化十大-痛点-解析及 对策[J]. 工矿自动化，2021，47(6)：1-11.

WANG Guofa，REN Huaiwei，ZHAO Guorui，et al. Analysis and countermeasures of ten-pain points-of intelligent coal mine[J]. Industry and Mine Automation，2021，47(6)：1-11.

3.付燕，李瑶，严斌斌. 一种煤矿井下视频图像增强算法[J]. 工矿 自动化，2018，44(7)：80-83.

FU Yan，LI Yao，YAN Binbin. An underground video image enhancement algorithm[J]. Industry and Mine Automation， 2018， 44(7)：80-83.

4.袁明道，谭彩，李阳，等. 基于图像融合和改进阈值的管道机器 人 探 测 图 像 增 强 方 法 [J]. 煤 田 地 质 与 勘 探 ， 2019， 47(4)： 178-185.

YUAN Mingdao，TAN Cai，LI Yang，et al. A pipeline robot detection image enhancement method based on image fusion and improved threshold[J]. Coal Geology & Exploration，2019，47(4)： 178-185.

5.智宁，毛善君，李梅. 基于照度调整的矿井非均匀照度视频图 像增强算法[J]. 煤炭学报，2017，42(8)：2190-2197.

ZHI Ning，MAO Shanjun，LI Mei. Enhancement algorithm based on illumination adjustment for non -uniform illumination video images in coal mine[J]. Journal of China Coal Society， 2017， 42(8)：2190-2197.

6.GUO Xiaojie，LI Yu，LING Haibin. LIME：Low-light image enhancement via illumination map estimation[J]. IEEE Transactions on Image Processing，2017，26(2)：982-993.

7.董静薇，赵春丽，海博. 融合同态滤波和小波变换的图像去雾 算法研究[J]. 哈尔滨理工大学学报，2019，24(1)：66-70.

DONG Jingwei，ZHAO Chunli，HAI Bo. Image research on image de-fog algorithm based on fusion homomorphic filtering and wavelet transform[J]. Journal of Harbin University of Science and Technology，2019，24(1)：66-70.

8.龚云，颉昕宇. 一种改进同态滤波的井下图像增强算法[J/OL]. 煤炭科学技术，2022：1-8[2022-11-22]. DOI：10.13199/j.cnki.cst. 2021-0774.

GONG Yun， XIE Xinyu. A downhole image enhancement algorithm based on improved homomorphic filtering[J/OL]. Coal Science and Technology，2022：1-8[2022-11-22]. DOI：10.13199/ j.cnki.cst.2021-0774.

9. LI Zhi，JIA Zhenhong，YANG Jie，et al. Low illumination video image enhancement[J]. IEEE Photonics Journal， 2020， 12(4)： 1-13.

10.郭伶俐，贾振红. 基于大气散射模型的低照度视频增强算法[J]. 激光杂志，2022，43(6)：105-110.

GUO Lingli， JIA Zhenhong. Low illumination video enhancement algorithm based on the atmospheric scattering model[J]. Laser Journal，2022，43(6)：105-110.

11.蔡利梅，向秀华，李紫阳. 自适应HSV空间Retinex煤矿监控图 像增强算法[J]. 电视技术，2017，41(4/5)：11-15.

CAI Limei， XIANG Xiuhua， LI Ziyang. Adaptive Retinex algorithm at HSV space for coal mine monitoring image enhancement[J]. Video Engineering，2017，41(4/5)：11-15.

12.HE Kaiming，SUN Jian，TANG Xiaoou. Single image haze removal using dark channel prior[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence，2011，33(12)：2341-2353.

13.蔡秀梅，马今璐，吴成茂，等. 基于模糊同态滤波的彩色图像增 强算法[J]. 计算机仿真，2020，37(6)：342-346.

CAI Xiumei，MA Jinlu，WU Chengmao，et al. Color image enhancement algorithm based on fuzzy homomorphic filtering[J]. Computer Simulation，2020，37(6)：342-346.

14.程德强，郑珍，姜海龙. 一种煤矿井下图像增强算法[J]. 工矿自 动化，2015，41(12)：31-34.

CHENG Deqiang，ZHENG Zhen，JIANG Hailong. An image enhancement algorithm for coal mine underground[J]. Industry and Mine Automation，2015，41(12)：31-34.

15.汪凤林，周扬，叶绿，等. 基于机器视觉的飞轮齿圈缺陷和尺寸 检测方法[J]. 中国测试，2020，46(5)：31-38.

WANG Fenglin，ZHOU Yang，YE Lyu，et al. Method for fault defection and size measurement for flywheel ring gear based on machine vision[J]. China Measurement & Testing Technology， 2020，46(5)：31-38.

16.方建荣，苏畅，周晓方，等. 一种CMOS图像传感器信号处理自 动白平衡算法[J]. 计算机工程，2015，41(9)：245-250.

FANG Jianrong， SU Chang， ZHOU Xiaofang， et al. An algorithm of automatic white balance for CMOS image sensor signal processing[J]. Computer Engineering，2015，41(9)：245-250.

17.NAYAR S K， NARASIMHAN S G. Vision in bad weather[C]//Proceedings of the IEEE International Conference on Computer Vision，1999：820-827.

18.DONG Xuan，WANG Guan，PANG Yi， et al. Fast efficient algorithm for enhancement of low lighting video[C]//IEEE International Conference on Multimedia and Expo，2011：1-6.

19.贾海鹏，张云泉，龙国平，等. 基于OpenCL的拉普拉斯图像增 强算法优化研究[J]. 计算机科学，2012，39(5)：271-277.

JIA Haipeng， ZHANG Yunquan， LONG Guoping， et al. Research on Laplace image enhancement algorithm optimization based on OpenCL[J]. Computer Science，2012，39(5)：271-277.

20.王小东，冯筠，鲁定国，等. 基于先验知识的肝脏轮廓线提取算 法研究[J]. 计算机应用研究，2014，31(1)：281-284.

WANG Xiaodong，FENG Jun，LU Dingguo，et al. Liver contour extraction based on prior knowledge model[J]. Application Research of Computers，2014，31(1)：281-284.

21.王媛彬，韦思雄，段誉，等. 基于自适应双通道先验的煤矿井下 图像去雾算法[J]. 工矿自动化，2022，48(5)：46-51.

WANG Yuanbin，WEI Sixiong，DUAN Yu，et al. Defogging algorithm of underground coal mine image based on adaptive dual-channel prior[J]. Industry and Mine Automation， 2022， 48(5)：46-51.

22.张英俊，雷耀花，潘理虎. 基于暗原色先验的煤矿井下图像增 强技术[J]. 工矿自动化，2015，41(3)：80-83.

ZHANG Yingjun， LEI Yaohua， PAN Lihu. Enhancement technique of underground image based on dark channel prior[J]. Industry and Mine Automation，2015，41(3)：80-83.