TY - JOUR
T1 - Degenerative adversarial neuroimage nets for brain scan simulations: Application in ageing and dementia
AU - for the Alzheimer's Disease Neuroimaging Initiative
AU - Ravi, Daniele
AU - Blumberg, Stefano B.
AU - Ingala, Silvia
AU - Barkhof, Frederik
AU - Alexander, Daniel C.
AU - Oxtoby, Neil P.
N1 - © 2021 The Author(s). Published by Elsevier B.V. This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY), https://creativecommons.org/licenses/by/4.0/
PY - 2022/1/1
Y1 - 2022/1/1
N2 - Accurate and realistic simulation of high-dimensional medical images has become an important research area relevant to many AI-enabled healthcare applications. However, current state-of-the-art approaches lack the ability to produce satisfactory high-resolution and accurate subject-specific images. In this work, we present a deep learning framework, namely 4D-Degenerative Adversarial NeuroImage Net (4D-DANI-Net), to generate high-resolution, longitudinal MRI scans that mimic subject-specific neurodegeneration in ageing and dementia. 4D-DANI-Net is a modular framework based on adversarial training and a set of novel spatiotemporal, biologically-informed constraints. To ensure efficient training and overcome memory limitations affecting such high-dimensional problems, we rely on three key technological advances: i) a new 3D training consistency mechanism called Profile Weight Functions (PWFs), ii) a 3D super-resolution module and iii) a transfer learning strategy to fine-tune the system for a given individual. To evaluate our approach, we trained the framework on 9852 T1-weighted MRI scans from 876 participants in the Alzheimer's Disease Neuroimaging Initiative dataset and held out a separate test set of 1283 MRI scans from 170 participants for quantitative and qualitative assessment of the personalised time series of synthetic images. We performed three evaluations: i) image quality assessment; ii) quantifying the accuracy of regional brain volumes over and above benchmark models; and iii) quantifying visual perception of the synthetic images by medical experts. Overall, both quantitative and qualitative results show that 4D-DANI-Net produces realistic, low-artefact, personalised time series of synthetic T1 MRI that outperforms benchmark models.
AB - Accurate and realistic simulation of high-dimensional medical images has become an important research area relevant to many AI-enabled healthcare applications. However, current state-of-the-art approaches lack the ability to produce satisfactory high-resolution and accurate subject-specific images. In this work, we present a deep learning framework, namely 4D-Degenerative Adversarial NeuroImage Net (4D-DANI-Net), to generate high-resolution, longitudinal MRI scans that mimic subject-specific neurodegeneration in ageing and dementia. 4D-DANI-Net is a modular framework based on adversarial training and a set of novel spatiotemporal, biologically-informed constraints. To ensure efficient training and overcome memory limitations affecting such high-dimensional problems, we rely on three key technological advances: i) a new 3D training consistency mechanism called Profile Weight Functions (PWFs), ii) a 3D super-resolution module and iii) a transfer learning strategy to fine-tune the system for a given individual. To evaluate our approach, we trained the framework on 9852 T1-weighted MRI scans from 876 participants in the Alzheimer's Disease Neuroimaging Initiative dataset and held out a separate test set of 1283 MRI scans from 170 participants for quantitative and qualitative assessment of the personalised time series of synthetic images. We performed three evaluations: i) image quality assessment; ii) quantifying the accuracy of regional brain volumes over and above benchmark models; and iii) quantifying visual perception of the synthetic images by medical experts. Overall, both quantitative and qualitative results show that 4D-DANI-Net produces realistic, low-artefact, personalised time series of synthetic T1 MRI that outperforms benchmark models.
KW - 4D-DANI-Net
KW - 4D-MRI
KW - Adversarial training
KW - Ageing
KW - Brain
KW - Dementia
KW - Disease progression modelling
KW - Generative models
KW - Neuro-image
KW - Neurodegeneration
KW - Synthetic-images
KW - Neuroimaging
KW - Humans
KW - Brain/diagnostic imaging
KW - Magnetic Resonance Imaging
KW - Image Processing, Computer-Assisted
KW - Aging
KW - Alzheimer Disease/diagnostic imaging
UR - http://www.scopus.com/inward/record.url?scp=85118351606&partnerID=8YFLogxK
U2 - 10.1016/j.media.2021.102257
DO - 10.1016/j.media.2021.102257
M3 - Article
C2 - 34731771
AN - SCOPUS:85118351606
SN - 1361-8415
VL - 75
SP - 1
EP - 15
JO - Medical Image Analysis
JF - Medical Image Analysis
M1 - 102257
ER -