Design and Experiment of Citrus Picking Robot in Hilly Orchard Natural Environment
Abstract
In the future development of orchard industry, intelligent orchard is an important development trend. In order to realize the intelligent orchard, intelligent fruit picking is one of the key bottlenecks. In order to achieve the goal of intelligent fruit picking, a citrus picking robot system suitable for hilly dwarf cultivation of fruit trees was built. Aiming at the uneven ground between ridges in hilly orchards and the terrain inclination angle of 0°~20°, an adaptive leveling platform was designed to keep the base level of the manipulator. The visual system used the depth camera to obtain the point cloud image to establish the three-dimensional model of the fruit tree, and realize the acquisition of the position information of the fruit to be picked. In order to avoid damage to the fruit during the picking process, an integrated end-effector for shearing and clamping was designed, which protected the fruit from damage while picking the fruit by shearing and clamping. The main interference factors in the orchard in the natural environment were light and wind. The light and wind were graded, and 10 foot control experiments were set up. The results showed that under low light or normal light conditions, the average fruit positioning accuracy was 82.5%, the end-effector clamping success rate was 87.5%, and the average fruit picking time was 12.3 s/piece.The average fruit positioning accuracy under high light conditions was 72%, the success rate of end-effector clamping was 80%, and the average time of fruit picking was 12.5 s/piece. The research result can provide a reference for the study of fruit picking in hilly terrain.
Keywords:citrus;picking robot;3D point cloud model;adaptive platform;end-effector
Download Full Text:
PDFReferences
DENG Xiuxin. Supply-side reform and development trend of China's fruit industry [ J ]. Modern Agricultural Equipment, 2018 (4): 13-16. ( in Chinese)
MALEKABADI A J, KHOJASTEHPOUR M, EM ADI B. Disparity map computation of tree using stereo vision system and effects of canopy shapes and foliage density [J] . Computers and Electronics in Agriculture, 2019, 156; 627 -644.
ARGUDO 0, CHICA A, ANDUJAR C. Single-picture reconstruction and rendering of trees for plausible vegetation synthesis [J] . Computers & Graphics, 2016, 57 ; 55 -67.
LESCOURRET F, MOITRIER N, VALSESIA P, et al. QualiTree, a virtual fruit tree to study the management of fruit quality. I. Model development [J ]. Structure and Function ,2011 ,25(3) :519 -530.
DALLABETTA N, COSTA F, GIORDAN M, et al. A 3D digitizing tool to determine fruit quality distribution within the canopy [J ]. Acta Horticulture, 2015(1160); 19-25.
GUO Cailing, ZONG Ze, ZHANG Xue, et al. Apple tree canopy geometric parameters acquirement based on 3D point clouds[ J ]. Transactions of the CSAE, 2017, 33(3) : 175 - 181.(in Chinese)
TANG L Y, HOU C, HUANG H Y, et al. Light interception efficiency analysis based on three-dimensional peach canopy models [J]. Ecological Informatics,2015 , 30; 60 -67.
WU Sheng, ZHAO Chunjiang, GUO Xinyu, et al. Method of fruit tree canopy leaf reconstruction based on point cloud [ J ]. Transactions of the CSAE, 2017, 33(Supp. 1 ) : 212 -218. (in Chinese)
TANG Liyu, ZHANG Hao, HUANG Hongyu, et al. Improved method for 3D reconstruction of tree model based on point cloud data[J ]. Transactions of the Chinese Society for Agricultural Machinery, 2017,48(2) : 186 - 194. (in Chinese)
WU Sheng, WEN Weiliang, WANG Chuanyu, et al. Research progress of digital fruit trees and its technology system [ J]. Transactions of the CSAE, 2021 , 37(9) : 350 -360. (in Chinese)
L0 Jidong, ZHAO Dean, JI Wei. Fast tracing recognition method of target fruit for apple harvesting robot[J ]. Transactions of
the Chinese Society for Agricultural Machinery, 2014,45( 1 ) :65 -72. ( in Chinese)
SILWAL A, GONGAL A, KARKEE M. Apple identification in field environment with over the row machine vision system [ J ]. Agricultural Engineering International: CIGR Journal, 2014, 16(4) ; 66 -75
LI Long, PENG Yankun, LI Yongyu, et al. Online identification of apple scarring and stems/calyxes based on texture and edge gradient features [J ]. Transactions of the Chinese Society for Agricultural Machinery, 2018,49 ( 11 ) : 328 - 335. (in Chinese)
WANG C, ZOU X, TANG Y, et al. Localisation of litchi in an unstructured environment using binocular stereo vision [ J]. Biosystems Engineering, 2016, 145; 39-51.
JI W, ZHAO D, CHENG F, et al. Automatic recognition vision system guided for apple harvesting robot [ J] . Computers & Electrical Engineering, 2012, 38(5): 1186 -1195.
ALTAHERI H, ALSULAIMAN M, MUHAMMAD G. Date fruit classification for robotic harvesting in a natural environment using deep learning J . IEEE Access, 2019, 7: 117115 -117133.
LIU W. The alexnet-resnet-inception network for classifying fruit images[J]. BioRxiv, 2020,2(9) ; 941039.
LIU Xiaogang, FAN Cheng, LI Jianian, et al. Identification method of strawberry based on convolutional neural network [ J ]. Transactions of the Chinese Society for Agricultural Machinery, 2020,51(2) ;237 -244. (in Chinese)
YAN Bin, FAN Pan, WANG Meirong, et al. Real-time apple picking pattern recognition for picking robot based on improved YOLO v5m[ J]. Transactions of the Chinese Society for Agricultural Machinery, 2022,53(9) :28 -38,59. (in Chinese)
YU Fenghua, ZHOU Chuanqi, YANG Xin, et al. Design and experiment of tomato picking robot in solar greenhouse [ J ]. Transactions of the Chinese Society for Agricultural Machinery, 2022,53( 1 ) :41 -49. (in Chinese)
LI Han, TAO Hanxiao, GUI Lihao, et al. Recognition and localization method of tomato based on SOM — К — means algorithm [J ]. Transactions of the Chinese Society for Agricultural Machinery, 2021 ,52 ( 1 ) ; 23 - 29. (in Chinese)
ZHANG Zhiguo. Research on monocular vision based positioning system [ D]. Wuhan : H uazhong University of Science and Teehnolov 2009. ( in Chinese')
Refbacks
- There are currently no refbacks.
