Repository logo
 

Equivariant neural networks for inverse problems

Published version
Peer-reviewed

Change log

Authors

Celledoni, Elena 
Ehrhardt, Matthias J 
Etmann, Christian 
Owren, Brynjulf 
Schönlieb, Carola-Bibiane  ORCID logo  https://orcid.org/0000-0003-0099-6306

Abstract

Abstract: In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into incorporating other symmetries into deep learning methods, in the form of group equivariant convolutional neural networks. Much of this work has been focused on roto-translational symmetry of R d , but other examples are the scaling symmetry of R d and rotational symmetry of the sphere. In this work, we demonstrate that group equivariant convolutional operations can naturally be incorporated into learned reconstruction methods for inverse problems that are motivated by the variational regularisation approach. Indeed, if the regularisation functional is invariant under a group symmetry, the corresponding proximal operator will satisfy an equivariance property with respect to the same group symmetry. As a result of this observation, we design learned iterative methods in which the proximal operators are modelled as group equivariant convolutional neural networks. We use roto-translationally equivariant operations in the proposed methodology and apply it to the problems of low-dose computerised tomography reconstruction and subsampled magnetic resonance imaging reconstruction. The proposed methodology is demonstrated to improve the reconstruction quality of a learned reconstruction method with a little extra computational cost at training time but without any extra cost at test time.

Description

Funder: Cantab Capital Institute for the Mathematics of Information


Funder: Alan Turing Institute; doi: https://doi.org/10.13039/100012338

Keywords

Paper, image reconstruction, variational regularisation, neural networks, equivariance

Journal Title

Inverse Problems

Conference Name

Journal ISSN

0266-5611
1361-6420

Volume Title

37

Publisher

IOP Publishing
Sponsorship
Norges Forskningsråd (No. 231632)
H2020 Marie Skłodowska-Curie Actions (No. 691070 CHiPS No. 777826 NoMADS)
Engineering and Physical Sciences Research Council (EP/N014588/1, EP/S026045/1, EP/T003553/1, EP/T007745/1, EP/T026693/1)
Leverhulme Trust (Breaking the non-convexity barrier, ECF-2019-478, Philip Leverhulme Prize)
Wellcome Trust (RG98755)