Repository logo

A generalized dual-domain generative framework with hierarchical consistency for medical image reconstruction and synthesis

Published version

Repository DOI

Change log


Sun, Kaicong 
Yang, Junwei 
Hu, Yan 
Gu, Yuning 


jats:titleAbstract</jats:title>jats:pMedical image reconstruction and synthesis are critical for imaging quality, disease diagnosis and treatment. Most of the existing generative models ignore the fact that medical imaging usually occurs in the acquisition domain, which is different from, but associated with, the image domain. Such methods exploit either single-domain or dual-domain information and suffer from inefficient information coupling across domains. Moreover, these models are usually designed specifically and not general enough for different tasks. Here we present a generalized dual-domain generative framework to facilitate the connections within and across domains by elaborately-designed hierarchical consistency constraints. A multi-stage learning strategy is proposed to construct hierarchical constraints effectively and stably. We conducted experiments for representative generative tasks including low-dose PET/CT reconstruction, CT metal artifact reduction, fast MRI reconstruction, and PET/CT synthesis. All these tasks share the same framework and achieve better performance, which validates the effectiveness of our framework. This technology is expected to be applied in clinical imaging to increase diagnosis efficiency and accuracy.</jats:p>


Acknowledgements: This work was supported in part by the National Natural Science Foundation of China (grant number 62131015), the Science and Technology Commission of Shanghai Municipality (STCSM) (grant number 21010502600), and The Key R&D Program of Guangdong Province, China (grant number 2021B0101420006).

Funder: The Key R&D Program of Guangdong Province, China (grant number 2021B0101420006)


46 Information and Computing Sciences, 32 Biomedical and Clinical Sciences, 3202 Clinical Sciences, Bioengineering, Biomedical Imaging

Journal Title

Communications Engineering

Conference Name

Journal ISSN


Volume Title



Springer Science and Business Media LLC
National Natural Science Foundation of China (National Science Foundation of China) (62131015)
Science and Technology Commission of Shanghai Municipality (Shanghai Municipal Science and Technology Commission) (21010502600)