Feature Mask-based Local Occlusion Cattle Face Recognition Method

QI Yongsheng, ZHANG Xinze, ZHANG Jiaying, LIU Liqiang, LI Yongting

Abstract

With the rapid development of intelligent animal husbandry, bovine face recognition has become the key to intelligent cattle breeding, but the problem of bovine face occlusion in practical application scenarios is more serious, which brings challenges to the performance of the recognition system. To solve this problem, a two-branch network structure based on occlude-assisted bovine face recognition was proposed. Firstly, an improved lightweight U-Net occlusion segmentation model was designed. By adding deep separable convolution and multi-scale mixing pool module, the occlusion segmentation performance of the segmentation network was effectively improved. Secondly, in order to better attenuate the influence of occlusions on bovine face recognition performance, a multilevel mask generation unit was introduced, and masks corresponding to different stages of the recognition network were constructed with different levels of occlusions as input. The damaged feature information caused by occlusions was effectively eliminated in each stage of feature extraction through mask operation. Finally, for the validity and real-time performance of the detection algorithm, the algorithm was verified on the selfmade data set, and compared with a variety of recent typical recognition algorithms. The experimental results showed that the proposed algorithm had an average accuracy of 86.34% on the blocked cow face data set, and the recognition speed was 54 f/s. Compared with the single-scale mask, the average accuracy of multistage mask was improved by 2.02 percentage points, and the recognition effect was better than that of the comparison network under different degrees of occlusion.

 

Keyword: occluded cattle face recognition ; image segmentation ; multi-level mask learning ; dual-branch structure

 

Download Full Text:

PDF


References


MAHMUD M S, ZAHID A, DAS A K, et al. A systematic literature review on deep learning applications for precision cattle farming [J]. Computers and Electronics in Agriculture, 2021, 187 : 1 -16.

YANG Mei, ZHAO Jianmin. Design of cow face recognition system for insurance business based on three-dimensional loss algorithm [ J ]. Journal of Optoelectronics* Laser, 2022 ,33 ( 8 ) ;831 -839. (in Chinese)

MANCUSO D, CASTAGNOLO G, PORTO S M C. Cow behavioural activities in extensive farms; challenges of adopting automatic monitoring systems[ J]. Sensors, 2023, 23(8): 3828.

UANG Xiaoping, FENG Гао, GUO Yangyang, et al. Lightweight dairy cow body condition scoring method based on improved YOLO v5s[ J ]. Transactions of the Chinese Society for Agricultural Machinery, 2023, 54(6) ; 287 -296. (in Chinese)

WANG Zheng, XU Xingshi, HUA Zhixin, et al. Lightweight recognition for the oestrus behavior of dairy cows combining YOLO 5n and channel pruning [j] . Transactions of the CSAE, 2022, 38(23) ; 130 - 140. (in Chinese)

WILLIAMS L R, FOX D R, BISHOP-HURLEY G J, et al. Use of radio frequency identification (RFID) technology to record grazing beef cattle water point use [J] . Computers and Electronics in Agriculture, 2019, 156; 193 -202.

KUMAR S, SINGH S K. Cattle recognition: a newr frontier in visual animal biometrics research [J]. Proceedings of the National Academy of Sciences India Section, 2020, 90(4) ; 689 -708.

WANG Jing, LI Weiran, LIU Yeqiang, et al. Reviewr of vision counting methods and applications for farmed animals [ J ]. Transactions of the Chinese Society for Agricultural Machinery, 2023, 54(Supp. 1 ) ; 315 -329. (in Chinese)

MYAT NOE S, ZIN T T, TIN P, et al. Comparing state-of-the-art deep learning algorithms for the automated detection and tracking of black cattle [J ]. Sensors, 2023, 23( 1 ) : 532.

XIE Qiuju, ZHOU Hong, BAO Jun, et al. Review on machine vision-based weight assessment for livestock and poultry [J] . Transactions of the Chinese Society for Agricultural Machinery, 2022, 53( 10) : 1 - 15. (in Chinese)

W ENG Z, MENG F, LIU S, et al. Cattle face recognition based on a two-branch convolutional neural network [J] . Computers and Electronics in Agriculture, 2022, 196: 1 -9.

LI Z, LEI X, LIU S. A lightweigh deep learning model for cattle face recognition [J]. Computers and Electronics in Agriculture, 2022, 195: 106848.

XU Beibei, WANG Wensheng, GUO Leifeng, et al. A review and future prospects on cattle recognition based on non-contact identification [ J ]. Journal of Agricultural Science and Technology ,2020, 22(7) : 79 -89. (in Chinese)

YANG Shuqin, WANG Zhen, HAN Yuanyuan, et al. Improved YOLO v4 model for face recognition of diary cow by fusing coordinate information[ J]. Transactions of the CSAE, 2021 , 37( 15): 129 - 135. ( in Chinese)

W ANG Y, HUA C, DING W, et al. Real-time detection of flame and smoke using an improved YOLO 4 network [J ]. Signal, Image and Video Processing, 2022, 16(4) : 1 109 - 1116.

LI Z, LEI X. Cattle face recognition under partial occlusion [J ]. Journal of Intelligent & Fuzzy Systems, 2022, 43( 1) : 67 -77.

LI Y, ZENG J, SHAN S, et al. Occlusion aware facial expression recognition using CNN with attention mechanism[J]. IEEE Transactions on Image Processing, 2018, 28(5) : 2439 -2450.

YUAN G, ZHENG H, DONG J. MSML: enhancing occlusion-robustness by multi-scale segmentation-based mask learning for face recognition[ С ] // Proceedings of the AAAI Conference on Artificial Intelligence, 2022; 3197 -3205.

ZENG D, VELDHUIS R, SPREEUWERS L, et al. Occlusion-invariant face recognition using simultaneous segmentation [J]. IET Biometrics, 2021, 10(6) : 679 - 691.

QIU H, GONG D, LI Z, et al. End2end occluded face recognition by masking corrupted features[ J ]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021 , 44(10) ; 6939 -6952.

SONG L, GONG D, LI Z, et al. Occlusion robust face recognition based on mask learning with pairwise differential siamese network [С] //Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019 : 773 -782.


Refbacks

  • There are currently no refbacks.