3D Reconstruction of Rape Branch and Pod Recognition Based on RGB-D Camera
Abstract
In order to achieve high-efficiency and low-cost 3D modeling of rapeseed plant and online measurement of phenotypic parameters, a method for rape branch 3D reconstruction and pod identification was proposed by using RGB-D camera. A Kinect sensor was adopted to gather the color and depth images of rape branch from four angles, and then the 3D point cloud of the branch was gained and filtered. A rotation transformation was performed on the point cloud that needed to be registered, and the surface normal vector and curvature of the point cloud were calculated. Point pairs were constituted the points with similar curvature, which were used for the initial registration of the point cloud by using the nearest point iterative (ICP) algorithm based on KD-tree search. Employing the reference value came from the initial registration error, the corresponding point distance threshold of ICP algorithm was adjusted, and then the new point cloud obtained by the initial registration was precisely registered by using the initial registration operation. Combined with the proposed 3D reconstruction and the specific color image processing, an integrated point cloud of the rape branch without the main stem was produced, and then the single rape pod was identified with the Euclidean distance clustering algorithm. The experiment results showed that the proposed method had good robust and real time, the 3D structure of single pod was clearly visible, the average distance error of the point cloud was less than 0.48mm, and the overall recognition rate of the pod was no less than 96.76%.
Keywords: rapeseed, Kinect, 3D reconstruction, point cloud registration, iterative closest point algorithm, pod recognition
Download Full Text:
PDFReferences
LI Lantao, KEN Tao, WANG Shanqin, et al. Prediction models of winter oilseed rape yield based on hyperspeetral data at pod- filling stage[ J/OL]. Transactions of the Chinese Society for Agricultural Machinery, 2017, 48(3) ; 221 -229. http://w ww. j- csam. org/jcsam/ch/reader/view_ahstract. aspx? flag = l&file_no = 20170328&joumal_id = jcsam. DOl: 10. 6041/j. issn. 1000- 1298.2017.03.028. (in Chinese)
FAN Zhenqi, SI Jingchun, HAN Xu,et al. Design mode for component-based virtual plant software J . Journal Agricultural Science & Technology, 2012, 13(4) :901 -903.
LI Shirui, LI Qi, LI llaiyang, et al. Real-time accurate ЗГ) reconstruction based on Kinect V2[J]. Journal of Software, 2016, 27( 10) : 2519 -2529. (in Chinese)
PAULUS S, SCHUMANN H, KUHLUMANN H, et al. High-precision laser scanning system for capturing 3D plant architecture and analysing growth of cereal plants[J]. Biosystems Engineering, 2014, 121 ; 1—11.
YAO Yidan, LIN Chengda, ZHAI Huifang, et al. Rapeseed 3 D reconstruction and morphological parameter measurement based on laser point cloud[ С]// International Conference on Agro-Geoinformatics, 2016.
ZHANG Weijie,LIU Gang, GUO (bailing,et al. Apple tree leaf three-dimensional reconstruction based on point cloud J/OL]. Transactions of the Chinese Society for Agricultural Machinery, 2017, 48(Supp. ) : 103 - 109. http://www.j-csam.org/jcsam/ ch/reader/view_abstract. aspx? flag = 1 &file_no = 2017s017&journal_id = jcsam. DOI; 10.6041 /j. issn. 1000-1298. 2017. SO. 017. (in Chinese)
XIONG Xiong, YU Lejun, YANG Wanneng, et al. A high-throughput stereo-imaging system for quantifying rape leaf traits during the seedling stage[ J]. Plant Methods, 2017, 13(1): 7.
WANG Chuanyu, GUO Xinyu, WU Sheng, et al. Three dimensional reconstruction of maize ear based on computer vision [ J/ OL]. Transactions of the Chinese Society for Agricultural Machinery, 2014, 45(9): 274 - 279. http;// www. j-csam. org/ jcsam/ch/reader/view_abstract. aspx? Hag = l&file_no = 20140944& journal _ id = jcsam. DOI; 10. 6041 /j. issn. 1000-1298. 2014.09.044. (in Chinese)
ZHANG Yanchao, ZHUANG Zaichun, XIAO Yuzhao, et al. Rape plant NDVI 3D distribution based on structure from motion [J]. Transactions of the CSAE, 2015 , 31 ( 17 ): 207 - 214. (in Chinese)
FANG Yihang, LIN Chengda, ZHAI Ruifang, et al. A new approach for measuring 3D digitalized rape leaf parameters based on images[ С] // International Conference on Agro-Geoinformatics, 2014; 1 -5.
ZONG Ze, GUO Cailing, ZHANG Xue, et al. Maize plant type parameters extraction based on depth camera [ J/OL ]. Transactions of the Chinese Society for Agricultural Machinery, 2015, 46(Supp. ) : 50 -56. http://www.j-csam.org/jcsam/ ch/reader/view_abstract. aspx? flag = l&file_no = 2015S009&joumal_id = jcsam. DOI: 10.6041/ j. issn. 1000-1298.2015. SO. 009. (in Chinese)
SALAU J, HAAS J H,JUNGE W,et al. Automated calculation of udder depth and rear leg angle in Holstein — Friesian cows using a multi-Kinect cow scanning system [ J]. Biosystems Engineering, 2017, 160; 154 - 169.
MAI Chunyan, ZHENG Lihua, SUN Hong, et al. Research on 31) reconstruction of fruit tree and fruit recognition and location method based on RGB —D camera[ J/OL]. Transactions of the Chinese Society for Agricultural Machinery, 2015 ,46( Supp. ) : 35 -40. http: // www. j-csam. org/jcsam/ch/reader/view_abstract. aspx? Hag = l&file_no = 2015S006&joumal_id = jcsam. DOIj 10.6041 /j. issn. 1000-1298. 2015. SO. 006. (in Chinese)
ITZ RABIN E, EDAN Y. Adaptive thresholding with fusion using a RGB — I) sensor for red sweet-pepper detection [ J]. Biosystems Engineering, 2016, 146: 45 -56.
GUO Kaiwen,XU Feng, YU Tao,et al. Real-time geometry, albedo, and motion reconstruction using a single RGB-D camera [J]. ACM Transactions on Graphics, 2017, 36(3) : 32.
JUAN R, TERVEN D, MARGARITA С E, et al. A multiple camera calibration and point cloud fusion tool for Kinect V2 [ J ]. Science of Computer Programming, 2017, 143: 1 ~8.
ZHENG Lihua, MAI Chunyan, LIAO Wei, et al. 3D point cloud registration for apple tree based on Kinect camera [J/OL ]. Transactions of the Chinese Society for Agricultural Machinery, 2016, 47 ( 5 ) : 9 - 14. http: // www. j-csam. org/jcsam/ch/ reader/view_abstract. aspx? flag = l&file_no = 20160502&joumal_id = jcsam. DOI; 10. 6041/j. issn. 1000-1298. 2016. 05. 002. ( in Chinese)
Refbacks
- There are currently no refbacks.