Deep learning methods for noisy sperm image classification from convolutional neural network to visual transformer:a comprehensive comparative study

作     者：Ao Chen Chen Li Md Mamunur Rahaman Yudong Yao Haoyuan Chen Hechen Yang Peng Zhao Weiming Hu Wanli Liu Shuojia Zou Ning Xu Marcin Grzegorzek Ao Chen;Chen Li;Md Mamunur Rahaman;Yudong Yao;Haoyuan Chen;Hechen Yang;Peng Zhao;Weiming Hu;Wanli Liu;Shuojia Zou;Ning Xu;Marcin Grzegorzek

作者机构：Microscopic Image and Medical Image Analysis GroupCollege of Medicine and Biological Information EngineeringNortheastern UniversityShenyangLiaoning 110169China Department of Electrical and Computer EngineeringStevens Institute of TechnologyHobokenNJ 07030USA School of Arts and DesignLiaoning Petrochemical UniversityFushunLiaoning 113001China Institute of Medical InformaticsUniversity of LübeckLüebeckGermany 

出 版 物：《Intelligent Medicine》 (智慧医学（英文）)

年 卷 期：2024年第4卷第2期

页      面：114-127页

核心收录：

学科分类：12[管理学] 1201[管理学-管理科学与工程(可授管理学、工学学位)] 081104[工学-模式识别与智能系统] 08[工学] 080203[工学-机械设计及理论] 0835[工学-软件工程] 0802[工学-机械工程] 0811[工学-控制科学与工程] 0812[工学-计算机科学与技术（可授工学、理学学位）] 

基　　金：supported by the National Natural Science Foundation of China(Grant No.82220108007) 

主　　题：Computer-assisted sperm analysis Anti-noise Robustness Deep learning .Image classification Sperm image Conventional noise Adversarial attacks Convolutional neural network Visual transformer 

摘      要：Background With the gradual increase of infertility in the world,among which male sperm problems are the main factor for infertility,more and more couples are using computer-assisted sperm analysis(CASA)to assist in the analysis and treatment of ***,the rapid development of deep learning(DL)has led to strong results in image classification ***,the classification of sperm images has not been well studied in current deep learning methods,and the sperm images are often affected by noise in practical CASA *** purpose of this article is to investigate the anti-noise robustness of deep learning classification methods applied on sperm *** The SVIA dataset is a publicly available large-scale sperm dataset containing three *** this work,we used subset-C,which provides more than 125,000 independent images of sperms and impurities,including 121,401 sperm images and 4,479 impurity *** investigate the anti-noise robustness of deep learning classification methods applied on sperm images,we conducted a comprehensive comparative study of sperm images using many convolutional neural network(CNN)and visual transformer(VT)deep learning methods to find the deep learning model with the most stable anti-noise *** This study proved that VT had strong robustness for the classification of tiny object(sperm and impurity)image datasets under some types of conventional noise and some adversarial *** particular,under the influence of Poisson noise,accuracy changed from 91.45%to 91.08%,impurity precison changed from 92.7%to 91.3%,impurity recall changed from 88.8%to 89.5%,and impurity F1-score changed 90.7%to 90.4%.Meanwhile,sperm precision changed from 90.9%to 90.5%,sperm recall changed from 92.5%to 93.8%,and sperm F1-score changed from 92.1%to 90.4%.Conclusion Sperm image classification may be strongly affected by noise in current deep learning methods;the robustness with regard to noise of VT methods based