Repository logo
 

Reviewable Automated Decision-Making

Accepted version
Peer-reviewed

Type

Article

Change log

Abstract

© 2020 Jennifer Cobbe and Jatinder Singh In this paper we introduce the concept of ‘reviewability' as an alternative approach to improving the accountability of automated decision-making that involves machine learning systems. In doing so, we draw on an understanding of automated decision-making as a socio-technical process, involving both human (organisational) and technical components, beginning before a decision is made and extending beyond the decision itself. Although explanations for automated decisions may be useful in some contexts, they focus more narrowly on the model and therefore do not provide the information about that process as a whole that is necessary for many aspects of accountability, regulatory oversight, and assessments for legal compliance. Drawing on previous work on the application of administrative law and judicial review mechanisms to automated decision-making in the public sector, we argue that breaking down the automated decision-making process into its technical and organisational components allows us to consider how appropriate record-keeping and logging mechanisms implemented at each stage of that process would allow for the process as a whole to be reviewed. Although significant research is needed to explore how it can be implemented, we argue that a reviewability framework potentially offers for a more useful and more holistic form of accountability for automated decision-making than approaches focused more narrowly on explanations.

Description

Keywords

automated decision-making, accountable systems, reviewability

Journal Title

Computer Law and Security Review: the International Journal of Technology Law and Practice

Conference Name

Journal ISSN

0267-3649

Volume Title

39

Publisher

Elsevier
Sponsorship
Engineering and Physical Sciences Research Council (EP/P024394/1)
Engineering and Physical Sciences Research Council (EP/R033501/1)