Automatic Extraction of Phenotypic Parameters from Anthurium andraeanum Linden Based on YOLO v8 and CycleGAN
Abstract
Phenotypic parameters of plants are quantitatively indicated, describing the morphology, structure, and physiological characteristics of plants, unveiling the growth patterns and relationships with environmental factors. Issues such as significant data errors, plant damage, high costs, and extensive data volume were exhibited by existing manual measurement and laser scanning-based methods for extracting plant phenotypic parameters. Therefore, an automatic extraction method for phenotypic parameters of Anthurium andraeanum Linden plants based on YOLO v8 and CycleGAN was proposed. The method included the follows: YOLO v8 was enhanced with the convolutional block attention module to improve the model’s feature extraction capabilities for detecting and segmenting Anthurium andraeanum Linden leaves;the Grabcut algorithm was utilized to eliminate background features from segmented images, and the VGG model was employed for classification to distinguish intact and missing Anthurium andraeanum Linden leaves;the convolutional block attention module and feature pyramid network were introduced into the CycleGAN generator to enhance multi-scale feature extraction capabilities, incorporating the SmoothL1 loss function to enhance model stability and repair missing Anthurium andraeanum Linden leaves;a phenotypic parameters extraction algorithm (PPEA) was proposed to automatically extract leaf length, leaf width, and leaf area of Anthurium andraeanum Linden plants. The proposed methods were compared and analyzed by using a dataset of 650 self-collected images. Experimental results demonstrated the effectiveness of the proposed approach in automatically extracting phenotypic parameters of Anthurium andraeanum Linden plants.
Keyword: phenotypic parameter extraction ; Anthurium andraeanum Linden ; target detection ; image restoration ; YOLO v8 ; CycleGAN
Download Full Text:
PDFReferences
TANG Zhixin. Acquisition and analysis image-based phenotypic traits of rice during the whole growth period [ D]. Wuhan; Huazhong Agricultural University,2023. (in Chinese)
ZHU C, MIAO T, XU T, et al. Stem-leaf segmentation and phenotypic trait extraction of maize shoots from three-dimensional point cloud[ J ]. arXiv Preprint, arXiv;2009. 03108,2020.
YANG X, HU S T, WANG Y H, et al. Cotton phenotypic trait extraction using multi-temporal laser point clouds [j] . Smart Agriculture, 2021 , 3( 1 ): 51 -62.
HU Songtao, ZHAI Ruifang, W ANG Yinghua, et al. Extraction of potato plant phenotypic parameters based on multi-source data[J]. Smart Agriculture, 2023, 5(1) : 132 - 145. (in Chinese)
TANG Z X, CHEN Z, GAO Y, et al. A strategy for the acquisition and analysis of image-based phenome in rice during the whole growth period [J]. Plant Phenomics, 2023,5: 0058.
JIANG Y, LI С Y. Convolutional neural networks for image-based high-throughput plant phenotyping: a review [J ]. Plant Phenomics, 2020, 2020: 4152816.
LI HI P, LI С Y, LI G B, et al. A real-time table grape detection method based on improved YOLO 4-tiny network in complex background [J ]. Biosystems Engineering, 2021 ,212; 347 -359.
ZHANG Fu, CHEN Zijun, BAO Ruofei, et al. Recognition of dense cherry tomatoes based on improved YOLO v4 - LITE lightweight neural network [ J]. Transactions of the CSAE, 2021 , 37( 16) : 270 -278. (in Chinese)
W ANG D D, HE D J. Channel pruned YOLO v5s-based deep learning approach for rapid and accurate apple fruitlet detection before fruit thinning [J]. Biosystems Engineering, 2021, 210;271 -281.
ZHANG Nannan, ZHANG Xiao, BAI Tiecheng, et al. Identification method of cotton leaf pests and diseases in natural environment based on CBAM “YOLO v7 [ J ]. Transactions of the Chinese Society for Agricultural Machinery, 2023, 54(Supp. 1 ) :239 - 244. (in Chinese)
XIA Y, NGUYEN M, YAN W Q. A real-time kiwifruit detection based on improved YOLO v7 [ С ] // International Conference on Image and Vision Computing, 2022; 48 -61.
MIAO Ronghui, LI Zhiwei, WU Jinlong. Lightweight maturity detection of cherry tomato based on improved YOLO v7 [ J]. Transactions of the Chinese Society for Agricultural Machinery, 2023,54( 10) ;225 -233. (in Chinese)
CHEN J Y, LIU H, ZHANG Y T, et al. A multiscale lightweight and efficient model based on YOLO v7 : applied to citrus orchard [J]. Plants, 2022, 11(23): 3260.
ZHOU J, ZHANG Y, WANG J. RDE — YOLO v7: an improved model based on YOLO v7 for better performance in detecting dragon fruits [ J ]. Agronomy, 2023, 13(4); 1042.
XIAO В J, NGUYEN M, YAN W Q. Fruit ripeness identification using YOLO v8 model J ]. Multimedia Tools and Applications, 2024, 83(9) : 28039 -28056.
QUE Y, DAI Y, JI X, et al. Automatic classification of asphalt pavement crac ks using a novel integrated generative adversarial networks and improved VGG model [J]. Engineering Structures, 2023, 277; 115406.
HAPSARI R A, PURWINARKO A. Implementation of convolutional neural network algorithm using VGG — 16 architecture for image classification in facial images[J]. Recursive Journal of Informatics, 2023, 1(2): 83 -92.
SHARMA S, GULERIA K. A deep learning based model for the detection of pneumonia from chest x-ray images using VGG— 16 and neural networks[j]. Procedia Computer Science, 2023, 218; 357 -366.
SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition [ J ]. arXiv Preprint, arXiv:1409.1556, 2014.
ZHU J V, PARK T, ISOLA P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks [С ] // 2017 IEEE International Conference on Computer Vision (ICCV). IEEE, 2017; 2242 -2251.
LIU K, LI В С, LI J L. Deep face-swap model combining attention mechanism and CycleGAN [С ] // 2022 6th International Conference on Machine Vision and Information Technology (CMVIT 2022) ,2022.
ENGIN D, GENC A, KEMAL EKENEL H. Cycle-dehaze: enhanced CycleGAN for single image dehazing [ С ] //2018 IEEE/ CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). IEEE, 2018: 825 -833.
XU Y, ZHANG HI, HE F, et al. Enhanced CycleGAN network with adaptive dark channel prior for unpaired single-image dehazing [J] . Entropy, 2023, 25(6): 856.
YAN B, YANG Z, SUN H, et al. ADE — CycleGAN: a detail enhanced image dehazing CycleGAN network [J] . Sensors, 2023, 23(6) : 3294.
ZHONG M, WANG X, WANG J, et al. A remote sensing image defogging method based on improved CycleGAN network [С]//2023 4th International Conference on Computer Vision, Image and Deep Learning (CVIDL). IEEE, 2023; 113 - 116.
Refbacks
- There are currently no refbacks.
