Equilibration of deep neural networks and carrier chirality in Rashba systems

Abstract

This thesis reports results of studies conducted on the equilibration of two systems and consists of two parts: the first part deals with the optimisation of deep neural networks, whereas the second part with the decay of non-equilibrium states in strongly Rashba-coupled systems at low temperature.

Deep learning is a conceptually simple, highly effective, and widely used tool, yet there remains insufficient understanding for why it works. The optimisation of deep neural networks with common algorithms such as stochastic gradient descent performs unexpectedly well given the complexity of the underlying high-dimensional non-convex minimisation problem. The first part of this thesis therefore looks at the optimisation procedure from the perspective of statistical physics. This allows us to interpret the loss function landscape of deep neural networks as the counterpart of the potential energy landscape in molecular systems and the optimisation of the network as its equilibration dynamics. Using landscape exploration tools developed in theoretical chemistry, we resolve the structure of the loss function landscape, from which we can draw conclusions for the relaxational dynamics of typical optimisers and, consequently, for deep learning.

The second part investigates how a non-equilibrium charge-carrier chirality distribution in a clean, strongly Rashba-coupled system at low temperatures decays over time. We first motivate this analysis based on experimental studies of transport properties in Rashba materials at low temperatures and subject to external magnetic fields. We investigate whether chirality imbalances could serve as the source for those experimental observations and develop a framework that models the behaviour of such a system. We then proceed with a more general theoretical study of the equilibration mechanisms of chirality in low-temperature strongly Rashba-coupled systems and compute the relaxation timescales of those mechanisms.