What is Interpretability?
Springer Science and Business Media LLC
MetadataShow full item record
Erasmus, A., Brunet, T. D., & Fisher, E. (2021). What is Interpretability?. Philos Technol, 34 (4), 833-862. https://doi.org/10.1007/s13347-020-00435-2
Funder: Ernest Oppenheimer Memorial Trust (ZA)
Funder: Williamson, Rausing and Lipton HPS Trust Fund (GB)
Funder: Wellcome Trust; doi: https://doi.org/10.13039/100004440
Funder: Cambridge Commonwealth, European and International Trust; doi: https://doi.org/10.13039/501100003343
Funder: Cambridge Commonwealth Trust; doi: https://doi.org/10.13039/501100003342
Funder: Social Sciences and Humanities Research Council of Canada; doi: https://doi.org/10.13039/501100000155
We argue that artificial networks are explainable and offer a novel theory of interpretability. Two sets of conceptual questions are prominent in theoretical engagements with artificial neural networks, especially in the context of medical artificial intelligence: (1) Are networks explainable, and if so, what does it mean to explain the output of a network? And (2) what does it mean for a network to be interpretable? We argue that accounts of "explanation" tailored specifically to neural networks have ineffectively reinvented the wheel. In response to (1), we show how four familiar accounts of explanation apply to neural networks as they would to any scientific phenomenon. We diagnose the confusion about explaining neural networks within the machine learning literature as an equivocation on "explainability," "understandability" and "interpretability." To remedy this, we distinguish between these notions, and answer (2) by offering a theory and typology of interpretation in machine learning. Interpretation is something one does to an explanation with the aim of producing another, more understandable, explanation. As with explanation, there are various concepts and methods involved in interpretation: Total or Partial, Global or Local, and Approximative or Isomorphic. Our account of "interpretability" is consistent with uses in the machine learning literature, in keeping with the philosophy of explanation and understanding, and pays special attention to medical artificial intelligence systems.
Research Article, Interpretability, Explainability, XAI, Medical AI
External DOI: https://doi.org/10.1007/s13347-020-00435-2
This record's URL: https://www.repository.cam.ac.uk/handle/1810/331818