In recent years, researchers have introduced various methods in many domains into medical image processing so that its effectiveness and efficiency can be improved to some extent. The applications of generative adversarial networks (GAN) in medical image processing are evolving very fast. In this paper, the state of the art in this area has been reviewed. Firstly, the basic concepts of the GAN were introduced. And then, from the perspectives of the medical image denoising, detection, segmentation, synthesis, reconstruction and classification, the applications of the GAN were summarized. Finally, prospects for further research in this area were presented.
Alzheimer's disease (AD) is a typical neurodegenerative disease, which is clinically manifested as amnesia, loss of language ability and self-care ability, and so on. So far, the cause of the disease has still been unclear and the course of the disease is irreversible, and there has been no cure for the disease yet. Hence, early prognosis of AD is important for the development of new drugs and measures to slow the progression of the disease. Mild cognitive impairment (MCI) is a state between AD and healthy controls (HC). Studies have shown that patients with MCI are more likely to develop AD than those without MCI. Therefore, accurate screening of MCI patients has become one of the research hotspots of early prognosis of AD. With the rapid development of neuroimaging techniques and deep learning, more and more researchers employ deep learning methods to analyze brain neuroimaging images, such as magnetic resonance imaging (MRI), for early prognosis of AD. Hence, in this paper, a three-dimensional multi-slice classifiers ensemble based on convolutional neural network (CNN) and ensemble learning for early prognosis of AD has been proposed. Compared with the CNN classification model based on a single slice, the proposed classifiers ensemble based on multiple two-dimensional slices from three dimensions could use more effective information contained in MRI to improve classification accuracy and stability in a parallel computing mode.
The pathogenesis of Alzheimer's disease (AD), a common neurodegenerative disease, is still unknown. It is difficult to determine the atrophy areas, especially for patients with mild cognitive impairment (MCI) at different stages of AD, which results in a low diagnostic rate. Therefore, an early diagnosis model of AD based on 3-dimensional convolutional neural network (3DCNN) and genetic algorithm (GA) was proposed. Firstly, the 3DCNN was used to train a base classifier for each region of interest (ROI). And then, the optimal combination of the base classifiers was determined with the GA. Finally, the ensemble consisting of the chosen base classifiers was employed to make a diagnosis for a patient and the brain regions with significant classification capability were decided. The experimental results showed that the classification accuracy was 88.6% for AD vs. normal control (NC), 88.1% for MCI patients who will convert to AD (MCIc) vs. NC, and 71.3% for MCI patients who will not convert to AD (MCInc) vs. MCIc. In addition, with the statistical analysis of the behavioral domains corresponding to ROIs (i.e. brain regions), besides left hippocampus, medial and lateral amygdala, and left para-hippocampal gyrus, anterior superior temporal sulcus of middle temporal gyrus and dorsal area 23 of cingulate gyrus were also found with GA. It is concluded that the functions of the selected brain regions mainly are relevant to emotions, memory, cognition and the like, which is basically consistent with the symptoms of indifference, memory losses, mobility decreases and cognitive declines in AD patients. All of these show that the proposed method is effective.
In the segmentation of aortic dissection, there are issues such as low contrast between the aortic dissection and surrounding organs and vessels, significant differences in dissection morphology, and high background noise. To address these issues, this paper proposed a reinforcement learning-based method for type B aortic dissection localization. With the assistance of a two-stage segmentation model, the deep reinforcement learning was utilized to perform the first-stage aortic dissection localization task, ensuring the integrity of the localization target. In the second stage, the coarse segmentation results from the first stage were used as input to obtain refined segmentation results. To improve the recall rate of the first-stage segmentation results and include the segmentation target more completely in the localization results, this paper designed a reinforcement learning reward function based on the direction of recall changes. Additionally, the localization window was separated from the field of view window to reduce the occurrence of segmentation target loss. Unet, TransUnet, SwinUnet, and MT-Unet were selected as benchmark segmentation models. Through experiments, it was verified that the majority of the metrics in the two-stage segmentation process of this paper performed better than the benchmark results. Specifically, the Dice index improved by 1.34%, 0.89%, 27.66%, and 7.37% for each respective model. In conclusion, by incorporating the type B aortic dissection localization method proposed in this paper into the segmentation process, the overall segmentation accuracy is improved compared to the benchmark models. The improvement is particularly significant for models with poorer segmentation performance.
Alzheimer’s disease (AD) is an irreversible neurodegenerative disorder that damages patients’ memory and cognitive abilities. Therefore, the diagnosis of AD holds significant importance. The interactions between regions of interest (ROIs) in the brain often involve multiple areas collaborating in a nonlinear manner. Leveraging these nonlinear higher-order interaction features to their fullest potential contributes to enhancing the accuracy of AD diagnosis. To address this, a framework combining nonlinear higher-order feature extraction and three-dimensional (3D) hypergraph neural networks is proposed for computer-assisted diagnosis of AD. First, a support vector machine regression model based on the radial basis function kernel was trained on ROI data to obtain a base estimator. Then, a recursive feature elimination algorithm based on the base estimator was applied to extract nonlinear higher-order features from functional magnetic resonance imaging (fMRI) data. These features were subsequently constructed into a hypergraph, leveraging the complex interactions captured in the data. Finally, a four-dimensional (4D) spatiotemporal hypergraph convolutional neural network model was constructed based on the fMRI data for classification. Experimental results on the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database demonstrated that the proposed framework outperformed the Hyper Graph Convolutional Network (HyperGCN) framework by 8% and traditional two-dimensional (2D) linear feature extraction methods by 12% in the AD/normal control (NC) classification task. In conclusion, this framework demonstrates an improvement in AD classification compared to mainstream deep learning methods, providing valuable evidence for computer-assisted diagnosis of AD.
Alzheimer’s Disease (AD) is a progressive neurodegenerative disorder. Due to the subtlety of symptoms in the early stages of AD, rapid and accurate clinical diagnosis is challenging, leading to a high rate of misdiagnosis. Current research on early diagnosis of AD has not sufficiently focused on tracking the progression of the disease over an extended period in subjects. To address this issue, this paper proposes an ensemble model for assisting early diagnosis of AD that combines structural magnetic resonance imaging (sMRI) data from two time points with clinical information. The model employs a three-dimensional convolutional neural network (3DCNN) and twin neural network modules to extract features from the sMRI data of subjects at two time points, while a multi-layer perceptron (MLP) is used to model the clinical information of the subjects. The objective is to extract AD-related features from the multi-modal data of the subjects as much as possible, thereby enhancing the diagnostic performance of the ensemble model. Experimental results show that based on this model, the classification accuracy rate is 89% for differentiating AD patients from normal controls (NC), 88% for differentiating mild cognitive impairment converting to AD (MCIc) from NC, and 69% for distinguishing non-converting mild cognitive impairment (MCInc) from MCIc, confirming the effectiveness and efficiency of the proposed method for early diagnosis of AD, as well as its potential to play a supportive role in the clinical diagnosis of early Alzheimer's disease.