Towards intelligent railway monitoring: A novel hybrid deep learning architecture for railway obstacle detection

Christopher Mai, Luca Eisentraut, Merlin Schadt and Ricardo Buettner

PLOS ONE, 2026, vol. 21, issue 5, 1-23

Abstract: Railways are among the most efficient modes of transportation, capable of moving large quantities of goods and passengers over long distances at relatively low cost. However, accidents frequently occur due to objects or individuals present on the tracks, as trains are unable to swerve and require long braking distances. While the localization of objects within the track bed is a well-explored topic, the reliable and high-performance classification of such obstacles across all relevant categories remains an unresolved challenge. This study proposes an innovative hybrid architecture that leverages the specific visual characteristics of track bed imagery, setting a new benchmark in this domain. The hybrid design effectively leverages the strengths of ResNet50 and Swin Transformer V2, allowing the model to capture both local and global features. In addition, an Efficient Attention Module is integrated to further emphasize the most relevant features for robust obstacle classification. Using stratified five-fold cross-validation on a dataset of 2,003 images across six classes (iron bar, boulder, person, branch, canister, and barrel), the model achieved an average balanced accuracy of 99.46%. The results have implications for accident prevention, improving operational efficiency, and modernizing railway safety systems, thereby enabling the future application of automatic railway surveillance systems to ultimately enhance operational security.

Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0349562 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 49562&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0349562

DOI: 10.1371/journal.pone.0349562

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().