Repository logo

ORDerly: Data Sets and Benchmarks for Chemical Reaction Data

Published version

Repository DOI

Change log


paragon-plus: 6414983  ORCID logo
Arrowsmith, Joe; paragon-plus: 6817088 
Pomberger, Alexander; paragon-plus: 4586531 
Felton, Kobi C.; paragon-plus: 5638172 
paragon-plus: 1153790 


Machine learning has the potential to provide tremendous value to life sciences by providing models that aid in the discovery of new molecules and reduce the time for new products to come to market. Chemical reactions play a significant role in these fields, but there is a lack of high-quality open-source chemical reaction data sets for training machine learning models. Herein, we present ORDerly, an open-source Python package for the customizable and reproducible preparation of reaction data stored in accordance with the increasingly popular Open Reaction Database (ORD) schema. We use ORDerly to clean United States patent data stored in ORD and generate data sets for forward prediction, retrosynthesis, as well as the first benchmark for reaction condition prediction. We train neural networks on data sets generated with ORDerly for condition prediction and show that data sets missing key cleaning steps can lead to silently overinflated performance metrics. Additionally, we train transformers for forward and retrosynthesis prediction and demonstrate how non-patent data can be used to evaluate model generalization. By providing a customizable open-source solution for cleaning and preparing large chemical reaction data, ORDerly is poised to push forward the boundaries of machine learning applications in chemistry.


Publication status: Published


Journal Title

Journal of Chemical Information and Modeling

Conference Name

Journal ISSN


Volume Title



American Chemical Society
Engineering and Physical Sciences Research Council (EP/S024220/1)
University of Cambridge (NA)
European Regional Development Fund (NA)