A real-world clinical validation for AI-based MRI monitoring in multiple sclerosis.

Published version
Repository DOI

Change log
Wang, Dongang 
Beadnall, Heidi 
Brunacci, David 

Modern management of MS targets No Evidence of Disease Activity (NEDA): no clinical relapses, no magnetic resonance imaging (MRI) disease activity and no disability worsening. While MRI is the principal tool available to neurologists for monitoring clinically silent MS disease activity and, where appropriate, escalating treatment, standard radiology reports are qualitative and may be insensitive to the development of new or enlarging lesions. Existing quantitative neuroimaging tools lack adequate clinical validation. In 397 multi-center MRI scan pairs acquired in routine practice, we demonstrate superior case-level sensitivity of a clinically integrated AI-based tool over standard radiology reports (93.3% vs 58.3%), relative to a consensus ground truth, with minimal loss of specificity. We also demonstrate equivalence of the AI-tool with a core clinical trial imaging lab for lesion activity and quantitative brain volumetric measures, including percentage brain volume loss (PBVC), an accepted biomarker of neurodegeneration in MS (mean PBVC -0.32% vs -0.36%, respectively), whereas even severe atrophy (>0.8% loss) was not appreciated in radiology reports. Finally, the AI-tool additionally embeds a clinically meaningful, experiential comparator that returns a relevant MS patient centile for lesion burden, revealing, in our cohort, inconsistencies in qualitative descriptors used in radiology reports. AI-based image quantitation enhances the accuracy of, and value-adds to, qualitative radiology reporting. Scaled deployment of these tools will open a path to precision management for patients with MS.


Acknowledgements: The authors would like to acknowledge funding support from Australian Government Department of Industry (CRCPFIVE000141). C.W. would like to acknowledge the support from the Nerve Research Foundation at The University of Sydney and Multiple Sclerosis Australia (18–0461).

4203 Health Services and Systems, 42 Health Sciences, Neurodegenerative, Clinical Research, Multiple Sclerosis, Clinical Trials and Supportive Activities, Bioengineering, Biomedical Imaging, Neurosciences, Brain Disorders, 4.2 Evaluation of markers and technologies, 4.1 Discovery and preclinical testing of markers and technologies, 4 Detection, screening and diagnosis, Neurological, 3 Good Health and Well Being
Journal Title
NPJ Digit Med
Conference Name
Journal ISSN
Volume Title
Springer Science and Business Media LLC
Cooperative Research Centres, Australian Government Department of Industry (CRCs) (CRCPFIVE000141, CRCPFIVE000141)
Multiple Sclerosis Research Australia (MSRA) (18-0461)