An improved automated testing model for maceral groups in coals based on DeeplabV3+

Authors

HU Jinwei, School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, ChinaFollow
XI Zhenghao, School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, ChinaFollow
XU Guozhong, School of Chemical Engineering, University of Science and Technology Liaoning, Anshan 114051, China
LI Zhongfeng, College of Electrical Engineering, Yingkou Institute of Technology, Yingkou 115000, China
LIU Xiang, School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China

Abstract

The identification of maceral groups in coals plays a critical role in analyzing the chemical properties of coals. However, manual identification is laborious and requires high expertise. Existing computer-assisted identification methods, mostly adopting deep learning-based semantic segmentation models, fail to accurately identify maceral groups in coals due to complex compositions of microscopic coal images and the presence of transitional components. Therefore, this study proposed an improved DeeplabV3+ semantic segmentation model integrating the Swin Transformer backbone network and the SkNet. First, to deal with the challenge of feature extraction caused by the intertwined maceral groups and the presence of transitional components in microscopic coal images, the Swin Transformer backbone network was used as the basic feature extraction network to enhance the feature extraction ability of the model for various maceral groups and to enable the information interaction between features of the segmentation network. Second, to improve the feature utilization rate of the Atrous Spatial Pyramid Pooling (ASPP) module in the model, the SkNet network was integrated into the ASPP to enable the ASPP to extract important features and suppress unnecessary features that interfere with the final prediction results. Finally, the improved DeeplabV3+ model was compared with existing advanced algorithms through experiments. As indicated by the comparison results, the improved model yielded pixel accuracy of 92.06% on the test set of microscopic coal images, which was 9.48%, 6.90%, and 3.40% higher than that of the random forest method, the U-Net semantic segmentation model, and the DeeplabV3+ semantic segmentation model, respectively. Furthermore, the improved model showed results similar to the manual point measurement method. Therefore, the improved model, outperforming the existing automatic identification models for coal maceral groups, can serve as a powerful method for the computer-assisted manual identification of maceral groups in coals.

Keywords

microscopic coal image, maceral group, automated testing, semantic segmentation model, Swin Transformer, SkNet

DOI

10.12363/issn.1001-1986.23.01.0013

Recommended Citation

HU Jinwei, XI Zhenghao, XU Guozhong, et al. (2023) "An improved automated testing model for maceral groups in coals based on DeeplabV3+," Coal Geology & Exploration: Vol. 51: Iss. 10, Article 5.
DOI: 10.12363/issn.1001-1986.23.01.0013
Available at: https://cge.researchcommons.org/journal/vol51/iss10/5

Reference

[1] GAO Xuerui,ZHAO Yong,LU Shibao,et al. Impact of coal power production on sustainable water resources management in the coal–fired power energy bases of Northern China[J]. Applied Energy,2019,250:821−833.

[2] WANG Hongdong,LEI Meng,CHEN Yilin,et al. Intelligent identification of maceral components of coal based on image segmentation and classification[J]. Applied Sciences,2019,9(16):3245.

[3] 范章群,宋孝忠. 新疆中生代煤中半镜质组特征及其研究意义[J]. 煤田地质与勘探,2014,42(5):9−12.

FAN Zhangqun,SONG Xiaozhong. Characteristics of semi–vitrinite of the Mesozoic coal in Xinjiang area and their research significance[J]. Coal Geology & Exploration,2014,42(5):9−12.

[4] 范章群. 我国煤岩学研究现状及前景分析[J]. 中国煤炭地质,2017,29(2):15−19.

FAN Zhangqun. Coal petrology study status quo and prospect in China[J]. Coal Geology of China,2017,29(2):15−19.

[5] MLYNARCZUK M ,SKIBA M. The application of artificial intelligence for the identification of the maceral groups and mineral components of coal[J]. Computers & Geosciences,2017,103:133−141.

[6] SINGH P K,SINGH M P,SINGH A K,et al. The prediction of the liquefaction behavior of the East Kalimantan coals of Indonesia:An appraisal through petrography of selected coal samples[J]. Energy Sources,2013,35(18):1728−1740.

[7] 宋孝忠,张群. 煤岩显微组分组图像自动识别系统与关键技术[J]. 煤炭学报,2019,44(10):3085−3097.

SONG Xiaozhong,ZHANG Qun. Automatic image recognition system and key technologies of maceral group[J]. Journal of China Coal Society,2019,44(10):3085−3097.

[8] 宋孝忠. 煤岩显微图像假边界对显微组分组自动识别的影响[J]. 煤田地质与勘探,2019,47(6):45−50.

SONG Xiaozhong. Effect of false boundary of microscopic image on automatic identification of maceral group[J]. Coal Geology & Exploration,2019,47(6):45−50.

[9] WANG Hongdong,LEI Meng,LI Ming,et al. Intelligent estimation of vitrinite reflectance of coal from photomicrographs based on machine learning[J]. Energies,2019,12(20):3855.

[10] WANG Yue,BAI Xiangfei,WU Linlin,et al. Identification of maceral groups in Chinese bituminous coals based on semantic segmentation models[J]. Fuel,2022,308:121844.

[11] CHEN L C，ZHU Yukun，PAPANDREOU G，et al. Encoder–decoder with atrous separable convolution for semantic image segmentation[C]//Proceedings of the European conference on computer vision (ECCV)，2018：801–818.

[12] HASAN P. Multi–task semantic segmentation of CT images for COVID–19 infections using DeepLabV3+ based on dilated residual network[J]. Physical and Engineering Sciences in Medicine,2022,45(2):443−455.

[13] LIU Ze，LIN Yutong，CAO Yue，et al. Swin transformer：Hierarchical vision transformer using shifted windows[C]//Proc. of the 2021 International Conference on Computer Vision，2021：10012–10022.

[14] FU Jun,LIU Jing,JIANG Jie,et al. Scene segmentation with dual relation–aware attention network[J]. IEEE Transactions on Neural Networks and Learning Systems,2021,32(6):2547−2560.

[15] MOU Lichao,HUA Yuansheng,ZHU Xiaoxiang. Relation matters:Relational context–aware fully convolutional network for semantic segmentation of high–resolution aerial images[J]. IEEE Transactions on Geoscience and Remote Sensing,2020,58(11):7557−7569.

[16] ZHENG Sixiao，LU Jiachen，ZHAO Hengshuang，et al. Rethinking semantic segmentation from a sequence–to–sequence perspective with transformers[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville：IEEE，2021：6877–6886.

[17] DOSOVITSKIY A，BEYER L，KOLESNIKOV A，et al. An image is worth 16x16 words：Transformers for image recognition at scale[C]//International Conference on Learning Representations，2021.

[18] LI Xiang，WANG Wenhai，HU Xiaolin，et al. Selective Kernel networks[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020.

[19] 中华人民共和国国家质量监督检验检疫总局，中国国家标准化管理委员会. 煤的显微组分组和矿物测定方法：GB/T 8899—2013[S]. 北京：中国标准出版社，2013.

[20] 中华人民共和国国家质量监督检验检疫总局，中国国家标准化管理委员会. 烟煤显微组分分类：GB/T 15588—2013[S]. 北京：中国标准出版社，2014.

[21] EVAN S,JONATHAN L,TREVOR D. Fully convolutional networks for semantic segmentation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence,2017,39(4):640−651.

[22] RONNEBERGER O，FISCHER P，BROX T. U–Net：Convolutional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Computer–assisted Intervention. Cham：Springer，2015：234–241.

[23] CHEN L C，PAPANDREOU G，SCHROFF F，et al. Rethinking atrous convolution for semantic image segmentation[J]. Computer Vision and Pattern Recognition，2017.