Yield Estimation of Winter Wheat Based on Multiple Remotely Sensed Parameters and CNN-Transformer
Abstract
In order to improve the accuracy of winter wheat yield estimation and the phenomena of underestimation of high yield and overestimation of low yield that exist in yield estimation models, the Guanzhong Plain in Shaanxi Province, China was taken as the study area, and the vegetation temperature condition index (VTCI), leaf area index (LAI) and fraction of photosynthetically active radiation (FPAR) at the ten-day interval were selected as remotely sensed parameters, and a deep learning model was proposed for estimating winter wheat yield by combining the local feature extraction capability of convolutional neural network (CNN) and the global information extraction capability of Transformer network based on the mechanism of self-attention. Compared with the Transformer model (R2 was 0.64, RMSE was 465.40kg/hm2, MAPE was 8.04%), the CNN-Transformer model had higher accuracy in estimating winter wheat yield (R2 was 0.70, RMSE was 420.39kg/hm2, MAPE was 7.65%), which can extract more yield-related information from the multiple remotely sensed parameters, and improved the underestimation of high yield and overestimation of low yield which existed in the Transformer model. The robustness and generalization ability of the CNN-Transformer model were further validated based on the five-fold cross-validation method and the leave-one-out method. In addition, based on the CNN-Transformer model, the cumulative effect of the winter wheat growth process was revealed, the impact of gradually accumulating ten-day scale input information on yield estimation was analyzed, and the ability of the model to characterize the accumulation process of winter wheat at different growth stages was assessed. The results showed that the model can effectively capture the critical period of winter wheat growth, which was from late March to early May.
Keywords: winter wheat; yield estimation; multiple remotely sensed parameters; convolutional neural network; Transformer model
Download Full Text:
PDFReferences
ZHAO Longcai, LI Fenling, CHANG Qingrui. Review on crop type identification and yield forecasting using remote sensing [ J ]. Transactions of the Chinese Society for Agricultural Machinery, 2023, 54(2) : 1 - 19. (in Chinese)
WU Bingfang, ZHANG Miao, ZENG Hongwei, et al. Twenty years of CropWatch; progress and prospect [ J], Journal of Remote Sensing, 2019, 23(6): 1053 -1063. (in Chinese)
CHEN Zhongxin, REN Jianqiang, TANG Huajun, et al. Progress and perspectives on agricultural remote sensing research and applications in China[J ]. Journal of Remote Sensing, 2016, 20(5) ; 748 -767. (in Chinese)
WANG Pengxin, TIAN Huiren, ZHANG Yue, et al. Crop growth monitoring and yield estimation based on deep learning: state of the art and beyond [J] . Transactions of the Chinese Society for Agricultural Machinery, 2022, 53(2) : 1 - 14. ( in Chinese)
WANG Pengxin, GONG Jianya, LI Xiaowen. Vegetation temperature condition index and its application for drought monitoring [J ]. Geomatics and Information Science of Wuhan University, 2001 , 26(5) ; 412 —418. (in Chinese)
ZHANG Y, WANG P, TANSEY K, et al. Enhanced feature extraction from assimilated VTCI and LAI with a particle filter for wheat yield estimation using cross-wavelet transform [ J ]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023, 16: 5115 -5127.
LI L, WANG B, FENG P, et al. Crop yield forecasting and associated optimum lead time analysis based on multi-source environmental data across China[J ]. Agricultural and Forest Meteorology, 2021 , 308: 108558.
LIU Junming, HE Xiaotong, WANG Pengxin, et al. Early prediction of winter wheat yield with long time series meteorological data and random forest method [ J ]. Transactions of the CSAE, 2019, 35(6) ; 158 - 166. ( in Chinese)
REICHSTEIN M, CAMPS-VALLS G, STEVENS В, et al. Deep learning and process understanding for data-driven earth system science [J], Nature, 2019, 566(7743): 195 -204.
YANG Q, Sill L, HAN J, et al. Deep convolutional neural networks for rice grain yield estimation at the ripening stage using UAV-based remotely sensed images[J ]. Field Crops Research, 2019, 235: 142 - 153.
LIN T, ZHONG R, WANG Y, et al. DeepCropNet; a deep spatial-temporal learning framework for county-level corn yield estimation[ J]. Environmental Research Letters, 2020, 15(3): 034016.
TIAN II, W ANG P, TANSEY K, et al. A deep learning framework under attention mechanism for wheat yield estimation using remotely sensed indices in the Guanzhong Plain, PR China [ J ]. International Journal of Applied Earth Observation and Geoinformation, 2021, 102; 102375.
BENGIO Y, SIMARD P, FRASCONI P. Learning long-term dependencies with gradient descent is difficult [ J ]. IEEE Transactions on Neural Networks, 1994, 5(2) ; 157 -166.
YU W, GONZALEZ J, LI X. Fast training of deep LSTM networks with guaranteed stability for nonlinear system modeling [J]. Neurocomputing, 2021 , 422; 85 -94.
VASW ANI A, SHAZEER N, PARMAR N, et al. Attention is all you need [ J ]. Advances in Neural Information Processing Systems, 2017, 30 : 5998 -6008.
ACHEAMPONG F A, NUNOO-MENSAH H, CHEN W. Transformer models for text-based emotion detection; a review of BERT-based approaches[J ]. Artificial Intelligence Review, 2021 , 54(8) : 5789 -5829.
LIU M, CHAI Z, DENG H, et al. A CNN — Transformer network with multiscale context aggregation for fine-grained cropland change detection! [J]. IEEE Journal of Selected Topics in Applied Earth Observationsand Remote Sensing, 2022, 15: 4297 - 4306.
ONOUFRIOU G, HANHEIDE M, LEONTIDIS G. Premonition net, a multi-timeline Transformer network architecture towards strawberry tabletop yield forecasting [ J ]. Computers and Electronics in Agriculture, 2023, 208; 107784.
JIN W, ZHANG W, IIU J, et al. Transformer for sub-seasonal extreme high temperature probabilistic forecasting over eastern China [J]. Theoretical and Applied Climatology, 2023, 151(1 -2): 65 -80.
LIANG S, HUA Z, LI J. Hybrid Transformer — CNN networks using superpixel segmentation for remote sensing building change detection [J] . International Journal of Remote Sensing, 2023, 44(8) ; 2754 -2780.
Refbacks
- There are currently no refbacks.
