Image Recognition at Night for Apple Picking Robot

Zhao Dean, Liu Xiaoyang, Chen Yu, Ji Wei, Jia Weikuan, Hu Chanli

Abstract

The paper presents a method of image recognition for apple picking robot at night. In the stage of image acquisition, comparing different lighting effects of light source, the proposed method selected the incandescent lamp as artificial lighting. And two lamps were placed in different sites to weaken shadow with 60° angle. In the stage of image segmentation, comparing the image recognition methods adopted in daytime, the improved R-G image recognition method was proposed. Referring to reflective areas in the surface of apples, twice segmentation method was proposed to separate reflective areas from images to repair segmented images above. The first segmentation aimed to determine the areas in where apples were located. The second segmentation aimed to determine the reflective areas in the determined areas of first segmentation. Taking no account of sheltered and adhesive apples, the rate of identification on the basis of the statistic of 60 images acquired at night can reach to 83.7%. This paper verified the ability of image recognition for apple picking robot at night and discussed the feasibility of apple picking at night.

 

Keywords: Apple, Picking, Night, Image recognition

 

Download Full Text:

PDF


References


Zhao Wenmin, Image recognition and posture detection of ripe apple based on machine vision[D ]. Nanjing: Nanjing Agricultural University, 2012. (in Chinese)

Lii Jidong. Research on vision measurement and obstacle avoidance control of apple harvesting robot [ D ]. Zhenjiang; Jiangsu University, 2012. (in Chinese)

Zhang Tiezhong, Yang Li,Chen Bingqi, et al. Research progress of agricultural robot technology[ J]. Science China: Information Technology, 2010, 40(Supp. 1) : 71 -87. (in Chinese)

Bi Kun, Zhao Xin, Hou Ruifeng, et al. The trend of application and development of robot technology in agriculture[ J ]. Chinese Agriculture Science Bulletin, 2011 , 27(4) ; 469 -473. (in Chinese)

David C, Roy C. Color vision in robotic fruit harvesting[ J]. Transactions of the ASAE, 1987, 30(4) : 1144 - 1148.

Zhou Jun, Liu Rui, Zhang Gaoyang. Design of fruit harvesting robot based on stereo vision [ J]. Transactions of the Chinese Society for Agricultural Machinery, 2010, 41(6) ; 158 - 162. (in Chinese)

Tanigaki K, Fujiura T, Akase A, et al. Cherry-harvesting robot[J]. Computers and Electronics in Agriculture, 2008, 63( 1) ; 65

Song Jian, Sun Xueyan, Zhang Tiezhong, et al. Design and experiment of opening picking robot for eggplant [J ]. Transactions of the Chinese Society for Agricultural Machinery, 2009, 40( 1 ) ; 143 - 147. ( in Chinese)

Zhao Qingbo, Zhao Dean, Ji Wei, et al. Vision servo control system of fruit harvesting robot [J ]. Transactions of the Chinese Society for Agricultural Machinery, 2009,40( 1 ) ; 152 - 156. ( in Chinese)

Jiang Huanyu, Peng Yongshi, Shen Chuan, et al. Recognizing and locating ripe tomatoes based on binocular stereo vision technology [ J]. Transactions of the CSAE, 2008, 24(8) ; 279 -283. (in Chinese)

Xie Zhiyong, Zhang Tiezhong, Zhao Jinying. Ripened straw berry recognition based on Hough transform [J]. Transactions of the Chinese Society for Agricultural Machinery ,2007 ,38 ( 3 ) : 106 - 109. (in Chinese)

Cai Jianrong,Li Yuliang,Fan Jun,et al. Image recognition and three-dimensional location of mature oranges from nature scene [J ]. Microcomputer Information ,2007 ,23 (12 ) ;224 -225,314. (in Chinese)

Zheng Xiaodong,Zhao Jiewen,Liu Muhua. Tomatoes recognition and location from nature background based on binocular stereo vision [ J ]. Computer Engineering, 2004 ,30 ( 22) : 115 - 116,171. (in Chinese )

Zhou Jun,Zhao Gaoyang,Liu Rui,et al. Apple attitude estimation based on particle filter for harvesting robot [ J]. Transactions of the Chinese Society for Agricultural Machinery,201 1 ,42(3) : 161 - 165. (in Chinese)

Xie Zhonghong, Xu Ying, Ji Changying, et al. Estimation method of apple growing attitude based on computer vision [ J]. Transactions of the Chinese Society for Agricultural Machinery ,201 1 ,42( 11 ) : 155 - 157, 153. (in Chinese)

Dong Tantan. Image recognition and posture detection of ripe tomato based on machine vision [ D]. Nanjing: Nanjing Agricultural University, 2012. (in Chinese)

Ji Wei,Tao Yun,Zhao Dean,et al. Iterative threshold segmentation of apple branch images based on CLAHE [J]. Transactions of the Chinese Society for Agricultural Machinery ,2014 ,45 (4) ;69 -75. (in Chinese)

Wang Hui,Mao Wenhua,Liu Gang, et al. Identification and location system of multi-operation apple robot based on vision combination [ J ]. Transactions of the Chinese Society for Agricultural Machinery ,2012 ,43 ( 12) ; 165 - 170. (in Chinese)

Font D, Palleja T, Tresanchez M, et al. Counting red grapes in vineyards by detecting specular spherical reflection peaks in RGB images obtained at night with artificial illumination [ J]. Computers and Electronics in Agriculture ,2014,108 ; 105 - 111.


Refbacks

  • There are currently no refbacks.