Classification Methods for Soft-yolk and Hard-yolk Preserved Eggs Based on Multimodal Information Fusion

TANG Wenquan, WANG Qiaohua, ZHANG Hao, YANG Zheng, FAN Wei

Abstract

The soft-yolk preserved eggs (SYP eggs) and hard-yolk preserved eggs (HYP eggs) each possess distinct textures and flavors, captivating their respective discerning consumers. Presently, artisans can only discern whether an egg is a soft-yolk or hard-yolk preserved egg based on the duration of the brining process, a method that not only demands their extensive expertise but also entails a high rate of misjudgment. To address this issue, the design of infrared imaging and visible/near-infrared spectroscopy acquisition devices was introduced, alongside a classification model for SYP eggs and HYP eggs. Utilizing gathered infrared image data, an enhanced model, ResNet_MLCA, was crafted by incorporating a mixed local channel attention (MLCA) module into the ResNet18 framework, achieving a noteworthy classification accuracy of 95.0% in distinguishing SYP eggs from HYP eggs. Furthermore, leveraging visible/near-infrared spectroscopy data, a one-dimensional residual module was designed, and through its stacking, the 1D_ResNet model for feature extraction and classification of visible/near-infrared spectroscopy data was developed, yielding an identical accuracy of 95.0% in discriminating SYP eggs from HYP eggs. In a bid to further augment detection accuracy, the infrared image features extracted by the ResNet_MLCA model and the visible/near-infrared spectroscopy features extracted by the 1D_ResNet were amalgamated. The resultant fusion model, ResNet_OP, achieved an outstanding classification accuracy of 98.3% in distinguishing SYP eggs from HYP eggs. In summary, this research can offer a novel, cost-effective, and high-precision classification model for SYP eggs and HYP eggs, which held significant implications for guiding preserved egg production and enhancing its quality. Additionally, the proposed method offered a theoretical reference for enhancing the performance of classification models for other agricultural products, aiming to further increase their accuracy and reduce the number of parameters in the fusion model.

 

Keywords: preserved egg, multimodal information fusion, ResNet;infrared imaging, visible/near-infrared spectroscopy, soft-yolk and hard-yolk

 

Download Full Text:

PDF


References


BATOOL Z, HU G, XINYUE H, et al. A comprehensive review on functional properties of preserved eggs as an excellent food ingredient with anti-inflammatory and anti-cancer aspects[J]. Food Bioscience, 2021 , 44: 101347.

МАО С, YU Z, LI C, et al. The functional properties of preserved eggs: from anti-cancer and anti-inflammatory aspects [ J]. Korean J. Food Sci. Anim. Resour. , 2018, 38(3) ; 615 -628.

ZHANG M, ZHAO Y, WU N, et al. The anti-inflammatory activity of peptides from simulated gastrointestinal digestion of preserved egg white in DSS-induced mouse colitis[ J ]. Food & Function, 2018, 9( 12) ; 6444 -6454.

GANASEN P, BENJAKUL S. Physical properties and microstructure of pidan yolk as affected by different divalent and monovalent cations [ J ]. LWT—Food Science and Technology, 2010, 43 ( 1) : 77 -85.

XUE H, HAN T, XU M, et al. Processing technology, principle, and nutritional characteristics of preserved eggs: a review [J ]. Trends in Food Science & Technology, 2022, 128: 265 -277.

GUO Jianjun, YANG Liu, ZHANG Enwei, et al. Design of cracked egg sorting system based on machine vision [ J ]. Modern Agricultural Equipment, 2024, 45( 1) : 45 -52. (in Chinese)

LIANG Xu, WANG Ling, ZHAO Shuhan. Research on egg classification and recognition based on residual neural network[ J]. Journal of Henan Agricultural University, 2024, 58(3) ; 456 -466. (in Chinese)

TANG W, HU J, WANG Q. High-throughput online visual detection method of cracked preserved eggs based on deep learning [J]. Applied Sciences, 2022, 12(3) :952.

HORKAEW P, KU PITTA Y AN ANT S, KUPITTAYANANT P. Noninvasive in ovo sexing in Korat chicken by pattern recognition of its embryologic vasculature[ J ]. Journal of Applied Poultry Research, 2024, 33(3) ; 100424.

SAH1N H A, ONDEK H. Use of deep learning to determine the freshness of egg [ J ]. Igdir Universitesi Fen Bilimleri EnstitUsU Dergisi, 2024, 14( 1): 493 -500.

BAl Junwen, JIN Jiaxin, SUN Li, et al. Detection of salt content in high-pressure pulsed salted duck eggs based on transmission images [ J ]. Transactions of the CSAE, 2024, 40(8) ; 245 -253. (in Chinese)

TANG W, ZHANG H, CHEN H, et al. A non-destructive detection and grading method of the internal quality of preserved eggs based on an improved ConvNext[ J ]. Foods, 2024, 13(6) ;925.

LIU Chengkang, LIU Yong, WANG Qiaohua, el al. Progress and prospect in non-destructive assessment technologies and equipment of fertilization and gender determination in hatching eggs [J] . Transactions of the Chinese Society for Agricultural Machinery, 2024, 55(5) : 1-20. (in Chinese)

GHADERI M, MIREE1 S A, MASOUMI A, et al. Fertility detection of unincubated chicken eggs by hyperspectral transmission imaging in the Vis-SWNIR region [J ]. Scientific Reports, 2024, 14(1): 1289.

CAI K, FANG Q, LIN Q, et al. Fast discrimination of female and male pigeon eggs using internet of things in combined with Vis-NIR spectroscopy and chemometrics[ J ]. Microchemical Journal, 2024, 203; 110883.

COZZOLINO D, SANAL P, SCHKEUDEK J, et al. Predicting egg storage time with a portable near-infrared instrument; effects of temperature and production system [J] . Foods, 2024, 13(2) : 212.

YAO K, SUN J, ZHANG B, et al. On-line monitoring of egg freshness using a portable NIK spectrometer combined with deep learning algorithm[ J ]. Infrared Physics & Technology, 2024, 138 : 105207.

CHEN Yuanzhe, WANG Qiaohua, GAO Sheng, et al. Hyperspectral imaging for prediction and visualization of water content and springiness as indicators of the gel quality of preserved eggs[ J]. Food Science, 2022, 43(2) ; 324 -331. (in Chinese)

CHEN Y, W ANG Q, FAN W, et al. Non-destructive determination and visualization of gel springiness of preserved eggs during pickling through hyperspectral imaging[ J ]. Food Bioscience, 2023, 53; 102605.

XU L, TANG Q, LY J, et al. Deep image captioning: a review of methods, trends and future challenges [ J]. Neurocomputing, 2023, 546: 126287.

XI Y, ZHANG Y, DING S, et al. Visual question answering model based on visual relationship detection [J] . Signal Processing: Image Communication, 2020, 80: 115648.

BELTRAN L, CAICEDO J, JOURNET N, et al. Deep multimodal learning for cross-modal retrieval; one model for all tasks [J]. Pattern Recognition Letters, 2021 , 146: 38 -45.

BIKJALI M, KASRI M, BENI-HSSANE A. A comprehensive survey on sentiment analysis: approaches, challenges and trends [J]. Knowledge-Based Systems, 2021 , 226; 107134.


Refbacks

  • There are currently no refbacks.