Instance Segmentation of Lotus Pods and Stalks in Unstructured Planting Environment Based on Improved YOLOv5

Ange Lu, Lingzhi Ma, Hao Cui (), Jun Liu and Qiucheng Ma
Additional contact information
Ange Lu: School of Mechanical Engineering and Mechanics, Xiangtan University, Xiangtan 411105, China
Lingzhi Ma: School of Mechanical Engineering and Mechanics, Xiangtan University, Xiangtan 411105, China
Hao Cui: School of Mechanical Engineering and Mechanics, Xiangtan University, Xiangtan 411105, China
Jun Liu: School of Mechanical Engineering and Mechanics, Xiangtan University, Xiangtan 411105, China
Qiucheng Ma: School of Mechanical Engineering and Mechanics, Xiangtan University, Xiangtan 411105, China

Agriculture, 2023, vol. 13, issue 8, 1-22

Abstract: Accurate segmentation of lotus pods and stalks with pose variability is a prerequisite for realizing the robotic harvesting of lotus pods. However, the complex growth environment of lotus pods causes great difficulties in conducting the above task. In this study, an instance segmentation model, LPSS-YOLOv5, for lotus pods and stalks based on the latest YOLOv5 v7.0 instance segmentation model was proposed. The CBAM attention mechanism was integrated into the network to improve the model’s feature extraction ability. The scale distribution of the multi-scale feature layer was adjusted, a 160 × 160 small-scale detection layer was added, and the original 20 × 20 large-scale detection layer was removed, which improved the model’s segmentation accuracy for small-scale lotus stalks and reduced the model size. On the medium-large scale test set, LPSS-YOLOv5 achieved a mask mAP 0 . 5 of 99.3% for all classes. On the small-scale test set, the mAP 0 . 5 for all classes and AP 0 . 5 for stalks were 88.8% and 83.3%, which were 2.6% and 5.0% higher than the baseline, respectively. Compared with the mainstream Mask R-CNN and YOLACT models, LPSS-YOLOv5 showed a much higher segmentation accuracy, speed, and smaller size. The 2D and 3D localization tests verified that LPSS-YOLOv5 could effectively support the picking point localization and the pod–stalk affiliation confirmation.

Keywords: lotus pods; instance segmentation; deep learning; YOLOv5; attention mechanism (search for similar items in EconPapers)
JEL-codes: Q1 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2077-0472/13/8/1568/pdf (application/pdf)
https://www.mdpi.com/2077-0472/13/8/1568/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jagris:v:13:y:2023:i:8:p:1568-:d:1211603

Access Statistics for this article

Agriculture is currently edited by Ms. Leda Xuan

More articles in Agriculture from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().