Repository logo
 

Decision Provenance: Harnessing data flow for accountable systems

Published version
Peer-reviewed

Type

Article

Change log

Authors

Norval, Chris 

Abstract

Demand is growing for more accountability regarding the technological systems that increasingly occupy our world. However, the complexity of many of these systems — often systems-of-systems — poses accountability challenges. This is because the details and nature of the information flows that interconnect and drive systems, which often occur across technical and organisational boundaries, tend to be invisible or opaque. This paper argues that data provenance methods show much promise as a technical means for increasing the transparency of these interconnected systems. Specifically, given the concerns regarding ever-increasing levels of automated and algorithmic decision-making, and so-called ‘algorithmic systems’ in general, we propose decision provenance as a concept showing much potential. Decision provenance entails using provenance methods to provide information exposing decision pipelines: chains of inputs to, nature of, and the flow-on effects from, the decisions and actions taken (at design and run-time) throughout systems. This paper introduces the concept of decision provenance, and takes an interdisciplinary (tech- legal) exploration into its potential for assisting accountability in algorithmic systems. We also indicate the implementation considerations and areas for research necessary to realise its vision. More generally, we make the case that considerations of data flow are important to discussions of accountability, complementing the community’s considerable focus on algorthmic specifics.

Description

Keywords

Accountability, AI, algorithmic & automated decision-making, data management, GDPR, governance, IoT, law, machine learning, privacy, provenance, security, systems of systems, transparency

Journal Title

IEEE Access

Conference Name

Journal ISSN

2169-3536
2169-3536

Volume Title

7

Publisher

IEEE
Sponsorship
Engineering and Physical Sciences Research Council (EP/P024394/1)
Engineering and Physical Sciences Research Council (EP/R033501/1)
EPSRC Microsoft (donation)