ECViST: Mine Intelligent Monitoring Based on Edge Computing and Vision Swin Transformer-YOLOv5

Fan Zhang, Jiawei Tian (), Jianhao Wang, Guanyou Liu and Ying Liu
Additional contact information
Fan Zhang: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Jiawei Tian: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Jianhao Wang: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Guanyou Liu: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Ying Liu: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China

Energies, 2022, vol. 15, issue 23, 1-15

Abstract: Mine video surveillance has a key role in ensuring the production safety of intelligent mining. However, existing mine intelligent monitoring technology mainly processes the video data in the cloud, which has problems, such as network congestion, large memory consumption, and untimely response to regional emergencies. In this paper, we address these limitations by utilizing the edge-cloud collaborative optimization framework. First, we obtained a coarse model using the edge-cloud collaborative architecture and updated this to realize the continuous improvement of the detection model. Second, we further proposed a target detection model based on the Vision Swin Transformer-YOLOv5(ViST-YOLOv5) algorithm and improved the model for edge device deployment. The experimental results showed that the object detection model based on ViST-YOLOv5, with a model size of only 27.057 MB, improved the average detection accuracy is by 25% compared to the state-of-the-art model, which makes it suitable for edge-end deployment in mining workface. For the actual mine surveillance video, the edge-cloud collaborative architecture can achieve better performance and robustness in typical application scenarios, such as weak lighting and occlusion, which verifies the feasibility of the designed architecture.

Keywords: mine intelligent monitoring; edge-cloud collaboration; object detection; vision swin transformer; YOLOv5 (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1996-1073/15/23/9015/pdf (application/pdf)
https://www.mdpi.com/1996-1073/15/23/9015/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:15:y:2022:i:23:p:9015-:d:987141

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().