Multimodal 3D Convolutional Neural Networks for Classification of Brain Disease Using Structural MR and FDG-PET Images

作     者：Kun Han Haiwei Pan Ruiqi Gao Jieyao Yu Bin Yang 

作者机构：Harbin Engineering University Harbin People’s Republic of China 

出 版 物：《国际计算机前沿大会会议论文集》 (International Conference of Pioneering Computer Scientists, Engineers and Educators（ICPCSEE）)

年 卷 期：2019年第1期

页      面：666-668页

学科分类：0303[法学-社会学] 03[法学] 

基　　金：the National Natural Science Foundation of China under Grant No. 61672181, No. 51679058 Natural Science Foundation of Heilongjiang Province under Grant No. F2016005. We would like to thank our teacher for guiding this paper. We would also like to thank classmates for their encouragement and help 

主　　题：Alzheimer’s disease MRI FDG-PET Convolutional neural networks Residual networks Deep learning Image classification 

摘      要：The classification and identification of brain diseases with multimodal information have attracted increasing attention in the domain of computer-aided. Compared with traditional method which use single modal feature information, multiple modal information fusion can classify and diagnose brain diseases more comprehensively and accurately in patient subjects. Existing multimodal methods require manual extraction of features or additional personal information, which consumes a lot of manual work. Furthermore, the difference between different modal images along with different manual feature extraction make it difficult for models to learn the optimal solution. In this paper, we propose a multimodal 3D convolutional neural networks framework for classification of brain disease diagnosis using MR images data and PET images data of subjects. We demonstrate the performance of the proposed approach for classification of Alzheimer’s disease (AD) versus mild cognitive impairment (MCI) and normal controls (NC) on the Alzheimer’s Disease National Initiative (ADNI) data set of 3D structural MRI brain scans and FDG-PET images. Experimental results show that the performance of the proposed method for AD vs. NC, MCI vs. NC are 93.55% and 78.92% accuracy respectively. And the accuracy of the results of AD, MCI and NC 3-classification experiments is 68.86%.