Attention and Pixel Matching in RGB-T Object Tracking

Da Li, Yao Zhang, Min Chen () and Haoxiang Chai
Additional contact information
Da Li: School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
Yao Zhang: School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
Min Chen: School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China
Haoxiang Chai: School of Information Engineering, Wuhan University of Technology, Wuhan 430070, China

Mathematics, 2023, vol. 11, issue 7, 1-12

Abstract: Visual object tracking using visible light images and thermal infrared images, named RGB-T tracking, has recently attracted increasing attention in the tracking community. Deep neural network-based methods becoming the most popular RGB-T trackers, still have to balance the robustness and the speed of calculation. A novel tracker with Siamese architecture is proposed to obtain the accurate object location and meet the real-time requirements. Firstly, a multi-modal weight penalty module is designed to assign different weights to the RGB and thermal infrared features. Secondly, a new pixel matching module is proposed to calculate the similarity between each pixel on the search and the template features, which can avoid bringing excessive background information versus the regular cross-correlation operation. Finally, an improved anchor-free bounding box prediction network is put forward to further reduce the interference of the background information. The experimental results on the standard RGB-T tracking benchmark datasets show that the proposed method achieves better precision and success rate with a speed of over 34 frames per second which satisfies the real-time tracking.

Keywords: RGB-T tracking; weight penalty; pixel matching; anchor-free (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/7/1646/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/7/1646/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:7:p:1646-:d:1110361

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().