Unveil the unseen: Exploit information hidden in noise

Published version
Repository DOI

Change log
Conduit, G 

jats:titleAbstract</jats:title>jats:pNoise and uncertainty are usually the enemy of machine learning, noise in training data leads to uncertainty and inaccuracy in the predictions. However, we develop a machine learning architecture that extracts crucial information out of the noise itself to improve the predictions. The phenomenology computes and then utilizes uncertainty in one target variable to predict a second target variable. We apply this formalism to PbZrjats:sub0.7</jats:sub>Snjats:sub0.3</jats:sub>jats:italicO</jats:italic>jats:sub3</jats:sub> crystal, using the uncertainty in dielectric constant to extrapolate heat capacity, correctly predicting a phase transition that otherwise cannot be extrapolated. For the second example – single-particle diffraction of droplets – we utilize the particle count together with its uncertainty to extrapolate the ground truth diffraction amplitude, delivering better predictions than when we utilize only the particle count. Our generic formalism enables the exploitation of uncertainty in machine learning, which has a broad range of applications in the physical sciences and beyond.</jats:p>


Funder: Engineering and Physical Sciences Research Council; doi: https://doi.org/10.13039/501100000266

Funder: Harding Distinguished Postgraduate Scholars Programme Leverage Scheme

Machine learning, Uncertainty, Extrapolation, Case studies
Journal Title
Applied Intelligence
Conference Name
Journal ISSN
Volume Title
Springer Science and Business Media LLC
The Royal Society (URF∖R∖201002)
Royal Society University Research Fellowship, Harding Distinguished Postgraduate Scholars Programme Leverage Scheme
Is supplemented by: