Repository logo
 

ORDerly: Data Sets and Benchmarks for Chemical Reaction Data.

Published version
Peer-reviewed

Repository DOI


Change log

Authors

Arrowsmith, Joe 
Pomberger, Alexander 
Felton, Kobi C 

Abstract

Machine learning has the potential to provide tremendous value to life sciences by providing models that aid in the discovery of new molecules and reduce the time for new products to come to market. Chemical reactions play a significant role in these fields, but there is a lack of high-quality open-source chemical reaction data sets for training machine learning models. Herein, we present ORDerly, an open-source Python package for the customizable and reproducible preparation of reaction data stored in accordance with the increasingly popular Open Reaction Database (ORD) schema. We use ORDerly to clean United States patent data stored in ORD and generate data sets for forward prediction, retrosynthesis, as well as the first benchmark for reaction condition prediction. We train neural networks on data sets generated with ORDerly for condition prediction and show that data sets missing key cleaning steps can lead to silently overinflated performance metrics. Additionally, we train transformers for forward and retrosynthesis prediction and demonstrate how non-patent data can be used to evaluate model generalization. By providing a customizable open-source solution for cleaning and preparing large chemical reaction data, ORDerly is poised to push forward the boundaries of machine learning applications in chemistry.

Description

Publication status: Published

Keywords

Machine Learning, Benchmarking, Neural Networks, Computer, Databases, Chemical

Journal Title

J Chem Inf Model

Conference Name

Journal ISSN

1549-9596
1549-960X

Volume Title

64

Publisher

American Chemical Society (ACS)
Sponsorship
Engineering and Physical Sciences Research Council (EP/S024220/1)