Repository logo
 

Investigating Bias and Fairness in Facial Expression Recognition.

Accepted version
Peer-reviewed

Type

Conference Object

Change log

Authors

Xu, Tian 
White, Jennifer 
Kalkan, Sinan 

Abstract

Recognition of expressions of emotions and a ect from facial images is a well-studied research problem in the elds of a ective computing and computer vision with a large number of datasets available containing facial images and corresponding expression labels. However, virtually none of these datasets have been acquired with consideration of fair distribution across the human population. Therefore, in this work, we undertake a systematic investigation of bias and fairness in facial expression recognition by comparing three di erent approaches, namely a baseline, an attribute-aware and a disentangled approach, on two wellknown datasets, RAF-DB and CelebA. Our results indicate that: (i) data augmentation improves the accuracy of the baseline model, but this alone is unable to mitigate the bias e ect; (ii) both the attribute-aware and the disentangled approaches equipped with data augmentation perform better than the baseline approach in terms of accuracy and fairness; (iii) the disentangled approach is the best for mitigating demographic bias; and (iv) the bias mitigation strategies are more suitable in the existence of uneven attribute distribution or imbalanced number of subgroup data.

Description

Keywords

Journal Title

ECCV Workshops (6)

Conference Name

16th European Conference on Computer Vision (ECCV 2020)

Journal ISSN

Volume Title

12540

Publisher

Springer

Rights

All rights reserved
Sponsorship
European Commission Horizon 2020 (H2020) Societal Challenges (826232)
European Union H2020