Instance Segmentation and Berry Counting of Table Grape before Thinning Based on AS-SwinT

作     者：Wensheng Du Ping Liu Wensheng Du;Ping Liu

作者机构：Shandong Agricultural Equipment Intelligent Engineering LaboratoryShandong Provincial Key Laboratory of HorticulturalMachinery and EquipmentCollege of Mechanical and Electronic EngineeringShandong Agricultural UniversityTai'an 271000China School of Construction MachineryShandong Jiaotong UniversityJinan 250357China 

出 版 物：《Plant Phenomics》 (植物表型组学（英文）)

年 卷 期：2023年第5卷第4期

页      面：703-713页

核心收录：

学科分类：09[农学] 0901[农学-作物学] 0902[农学-园艺学] 090201[农学-果树学] 

基　　金：supported partially by Key R&D Program of Shandong Province,China(Nos.2022TZXD0010,2022LZGCQY002,and 2021TZXD001) the Natural Science Foundation of Shandong(No.ZR2020KF002) the project of Shandong provincial key laboratory of horticultural machinery and equipment(No.YYJX201905). 

主　　题：Berry network removed 

摘      要：Berry thinning is one of the most important tasks in the management of high-quality table grapes.Farmers often thin the berries per cluster to a standard number by counting.With an aging population,it is hard to find adequate skilled farmers to work during thinning season.It is urgent to design an intelligent berry-thinning machine to avoid exhaustive repetitive labor.A machine vision system that can determine the number of berries removed and locate the berries removed is a challenge for the thinning machine.A method for instance segmentation of berries and berry counting in a single bunch is proposed based on AS-SwinT.In AS-Swin T,Swin Transformer is performed as the backbone to extract the rich characteristics of grape berries.An adaptive feature fusion is introduced to the neck network to sufficiently preserve the underlying features and enhance the detection of small berries.The size of berries in the dataset is statistically analyzed to optimize the anchor scale,and Soft-NMS is used to filter the candidate frames to reduce the missed detection of densely shaded berries.Finally,the proposed method could achieve 65.7 AP^(box),95.0 AP^(box)_(0.5),57 AP^(box)_(s),62.8 AP^(mask)94.3 AP^(mask)_(0.5),48 AP^(mask)_(s),which is markedly superior to Mask R-CNN,Mask Scoring R-CNN,and Cascade Mask R-CNN.Linear regressions between predicted numbers and actual numbers are also developed to verify the precision of the proposed model.RMSE and R^(2)values are 7.13 and 0.95,respectively,which are substantially higher than other models,showing the advantage of the AS-SwinT model in berry counting estimation.