How can we make gan perform better in single medical image super-resolution? A lesion focused multi-scale approach
Proceedings - International Symposium on Biomedical Imaging
2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI)
MetadataShow full item record
Zhu, J., Yang, G., & Lio, P. (2019). How can we make gan perform better in single medical image super-resolution? A lesion focused multi-scale approach. Proceedings - International Symposium on Biomedical Imaging, 2019-April 1669-1673. https://doi.org/10.1109/ISBI.2019.8759517
Single image super-resolution (SISR) is of great importance as a low-level computer vision task. The fast development of Generative Adversarial Network (GAN) based deep learning architectures realises an efficient and effective SISR to boost the spatial resolution of natural images captured by digital cameras. However, the SISR for medical images is still a very challenging problem. This is due to (1) compared to natural images, in general, medical images have lower signal to noise ratios, (2) GAN based models pre-trained on natural images may synthesise unrealistic patterns in medical images which could affect the clinical interpretation and diagnosis, and (3) the vanilla GAN architecture may suffer from unstable training and collapse mode that can also affect the SISR results. In this paper, we propose a novel lesion focused SR (LFSR) method, which incorporates GAN to achieve perceptually realistic SISR results for brain tumour MRI images. More importantly, we test and make comparison using recently developed GAN variations, e.g., Wasserstein GAN (WGAN) and WGAN with Gradient Penalty (WGAN-GP), and propose a novel multi-scale GAN (MS-GAN), to achieve a more stabilised and efficient training and improved perceptual quality of the super-resolved results. Based on both quantitative evaluations and our designed mean opinion score, the proposed LFSR coupled with MS-GAN has performed better in terms of both perceptual quality and efficiency.
Jin Zhu’s PhD research is funded by China Scholarship Council (grant No.201708060173). Guang Yang is funded by the British Heart Foundation Project Grant (Project Number: PG/16/78/32402).
External DOI: https://doi.org/10.1109/ISBI.2019.8759517
This record's URL: https://www.repository.cam.ac.uk/handle/1810/293223
All rights reserved