FRESH: Fusion-Based 3D Apple Recognition via Estimating Stem Direction Heading

Geonhwa Son, Seunghyeon Lee and Yukyung Choi ()
Additional contact information
Geonhwa Son: Department of Artificial Intelligence and Robotics, Sejong University, Seoul 05006, Republic of Korea
Seunghyeon Lee: Department of Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea
Yukyung Choi: Department of Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea

Agriculture, 2024, vol. 14, issue 12, 1-17

Abstract: In 3D apple detection, the challenge of direction for apple stem harvesting for agricultural robotics has not yet been resolved. Addressing the issue of determining the stem direction of apples is essential for the harvesting processes employed by automated robots. This research proposes a 3D apple detection framework to identify stem direction. First, we constructed a dataset for 3D apple detection that considers the 3-axis rotation of apples based on stem direction. Secondly, we designed a 3D detection algorithm that not only recognizes the dimensions and location of apples, as existing methods do, but also predicts their 3-axis rotation. Furthermore, we effectively fused 3D point clouds with 2D images to leverage the geometric data from point clouds and the semantic information from images, enhancing the apple detection performance. Experimental results indicated that our method achieved AP@0.25 89.56% for 3D detection by considering apple rotation, surpassing the existing methods. Moreover, we experimentally validated that the proposed loss function most effectively estimated the rotation among the various approaches we explored. This study shows the effectiveness of 3D apple detection with consideration of rotation, emphasizing its potential for practical application in autonomous robotic systems.

Keywords: smart agriculture; deep learning; 3D detection; stem direction estimation (search for similar items in EconPapers)
JEL-codes: Q1 Q10 Q11 Q12 Q13 Q14 Q15 Q16 Q17 Q18 (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2077-0472/14/12/2161/pdf (application/pdf)
https://www.mdpi.com/2077-0472/14/12/2161/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jagris:v:14:y:2024:i:12:p:2161-:d:1531281

Access Statistics for this article

Agriculture is currently edited by Ms. Leda Xuan

More articles in Agriculture from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().