D-P-Transformer: A Distilling and Probsparse Self-Attention Rockburst Prediction Method

Yu Zhang, Jitao Li, Dongqiao Liu, Guangshu Chen and Jiaming Dou
Additional contact information
Yu Zhang: School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Jitao Li: School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Dongqiao Liu: State Key Laboratory for GeoMechanics and Deep Underground Engineering, China University of Mining & Technology, Beijing 100083, China
Guangshu Chen: School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Jiaming Dou: School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, Beijing 100044, China

Energies, 2022, vol. 15, issue 11, 1-17

Abstract: Rockburst may cause damage to engineering equipment, disrupt construction progress, and endanger human life. To this day, the occurrence of rockburst remains complex and difficult to predict. This study proposes the D-P-Transformer algorithm to address this issue by improving the embedding structure of the Transformer for specific applications to rockburst data. To reduce the computational requirement, sparse self-attention is adopted to replace self-attention. A distilling operation and multiple layer replicas are simultaneously used to enhance the robustness and speed up the algorithm’s process. Taking all relevant rockburst factors into consideration, multiple experiments are conducted on seven large-scale rockburst datasets with different training ratios to verify the reliability of the proposed D-P-Transformer rockburst prediction algorithm. As compared to the original algorithm, the proposed algorithm shows average reductions of 24.45%, 46.56%, 17.32%, and 48.11% in the mean absolute error (MAE), mean square error (MSE), root mean square error (RMSE), and mean absolute percentage error (MAPE), respectively. The results indicate that the novel D-P-Transformer rockburst prediction algorithm is superior to the Transformer prediction algorithm, and could be used for coal mine rockburst prediction analysis.

Keywords: rockburst prediction; acoustic emission; absolute energy; transformer; probsparse self-attention; distilling (search for similar items in EconPapers)
JEL-codes: Q Q0 Q4 Q40 Q41 Q42 Q43 Q47 Q48 Q49 (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/1996-1073/15/11/3959/pdf (application/pdf)
https://www.mdpi.com/1996-1073/15/11/3959/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jeners:v:15:y:2022:i:11:p:3959-:d:825647

Access Statistics for this article

Energies is currently edited by Ms. Agatha Cao

More articles in Energies from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().