City Research Online

Unsupervised Multi-modal Style Transfer for Cardiac MR Segmentation

Chen, C., Ouyang, C., Tarroni, G. ORCID: 0000-0002-0341-6138, Schlemper, J., Qiu, H., Bai, W. and Rueckert, D. (2020). Unsupervised Multi-modal Style Transfer for Cardiac MR Segmentation. In: Pop, M., Sermesant, M., Camara, O., Zhuang, X., Li, S., Young, A., Mansi, T. and Suinesiaputra, A. (Eds.), Statistical Atlases and Computational Models of the Heart. Multi-Sequence CMR Segmentation, CRT-EPiggy and LV Full Quantification Challenges. STACOM 2019. (pp. 209-219). Cham, Switzerland: Springer. ISBN 978-3-030-39073-0

Abstract

In this work, we present a fully automatic method to segment cardiac structures from late-gadolinium enhanced (LGE) images without using labelled LGE data for training, but instead by transferring the anatomical knowledge and features learned on annotated balanced steady-state free precession (bSSFP) images, which are easier to acquire. Our framework mainly consists of two neural networks: a multi-modal image translation network for style transfer and a cascaded segmentation network for image segmentation. The multi-modal image translation network generates realistic and diverse synthetic LGE images conditioned on a single annotated bSSFP image, forming a synthetic LGE training set. This set is then utilized to fine-tune the segmentation network pre-trained on labelled bSSFP images, achieving the goal of unsupervised LGE image segmentation. In particular, the proposed cascaded segmentation network is able to produce accurate segmentation by taking both shape prior and image appearance into account, achieving an average Dice score of 0.92 for the left ventricle, 0.83 for the myocardium, and 0.88 for the right ventricle on the test set.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: The final authenticated version is available online at https://doi.org/10.1007/978-3-030-39074-7_22
Publisher Keywords: eess.IV; eess.IV; cs.CV; cs.LG
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
URI: https://openaccess.city.ac.uk/id/eprint/23501
[img]
Preview
Text - Accepted Version
Download (1MB) | Preview

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login