Automated Behavior Recognition and Tracking of Group-Housed Pigs with an Improved DeepSORT Method

Shuqin Tu, Qiantao Zeng, Yun Liang (), Xiaolong Liu, Lei Huang, Shitong Weng and Qiong Huang
Additional contact information
Shuqin Tu: College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510642, China
Qiantao Zeng: College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510642, China
Yun Liang: College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510642, China
Xiaolong Liu: College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510642, China
Lei Huang: College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510642, China
Shitong Weng: College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510642, China
Qiong Huang: College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510642, China

Agriculture, 2022, vol. 12, issue 11, 1-20

Abstract: Pig behavior recognition and tracking in group-housed livestock are effective aids for health and welfare monitoring in commercial settings. However, due to demanding farm conditions, the targets in the pig videos are heavily occluded and overlapped, and there are illumination changes, which cause error switches of pig identify (ID) in the tracking process and decrease the tracking quality. To solve these problems, this study proposed an improved DeepSORT algorithm for object tracking, which contained three processes. Firstly, two detectors, YOLOX-S and YOLO v5s, were developed to detect pig targets and classify four types of pig behaviors including lying, eating, standing, and other. Then, the improved DeepSORT was developed for pig behavior tracking and reducing error changes of pig ID by improving trajectory processing and data association. Finally, we established the public dataset annotation of group-housed pigs, with 3600 images in a total from 12 videos, which were suitable for pig tracking applications. The advantage of our method includes two aspects. One is that the trajectory processing and data association are improved by aiming at pig-specific scenarios, which are indoor scenes, and the number of pig target objects is stable. This improvement reduces the error switches of pig ID and enhances the stability of the tracking. The other is that the behavior classification information from the detectors is introduced into the tracking algorithm for behavior tracking. In the experiments of pig detection and behavior recognition, the YOLO v5s and YOLOX-S detectors achieved a high precision rate of 99.4% and 98.43%, a recall rate of 99% and 99.23, and a mean average precision (mAP) rate of 99.50% and 99.23%, respectively, with an AP.5:.95 of 89.3% and 87%. In the experiments of pig behavior tracking, the improved DeepSORT algorithm based on YOLOX-S obtained multi-object tracking accuracy (MOTA), ID switches (IDs), and IDF1 of 98.6%,15, and 95.7%, respectively. Compared with DeepSORT, it improved by 1.8% and 6.8% in MOTA and IDF1, respectively, and IDs had a significant decrease, with a decline of 80%. These experiments demonstrate that the improved DeepSORT can achieve pig behavior tracking with stable ID values under commercial conditions and provide scalable technical support for contactless automated pig monitoring.

Keywords: YOLOX-S; pig behavior tracking; YOLO v5s; DeepSORT; ID switch (search for similar items in EconPapers)
JEL-codes: Q1 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2077-0472/12/11/1907/pdf (application/pdf)
https://www.mdpi.com/2077-0472/12/11/1907/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jagris:v:12:y:2022:i:11:p:1907-:d:970945

Access Statistics for this article

Agriculture is currently edited by Ms. Leda Xuan

More articles in Agriculture from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().