Alone versus In-a-group: A Comparative Analysis of Facial Affect Recognition


Type
Conference Object
Change log
Authors
Mou, W 
Patras, I 
Abstract

Automatic affect analysis and understanding has become a well established research area in the last two decades. Recent works have started moving from individual to group scenarios. However, little attention has been paid to comparing the affect expressed in individual and group settings. This paper presents a framework to investigate the differences in affect recognition models along arousal and valence dimensions in individual and group settings. We analyse how a model trained on data collected from an individual setting performs on test data collected from a group setting, and vice versa. A third model combining data from both individual and group settings is also investigated. A set of experiments is conducted to predict the affiective states along both arousal and valence dimensions on two newly collected databases that contain sixteen participants watching affiective movie stimuli in individual and group settings, respectively. The experimental results show that (1) the affect model trained with group data performs better on individual test data than the model trained with individual data tested on group data, indicating that facial behaviours expressed in a group setting capture more variation than in an individual setting; and (2) the combined model does not show better performance than the affect model trained with a specific type of data (i.e., individual or group), but proves a good compromise. These results indicate that in settings where multiple affect models trained with different types of data are not available, using the affect model trained with group data is a viable solution.

Description
Keywords
46 Information and Computing Sciences, 4608 Human-Centred Computing, Basic Behavioral and Social Science, Pediatric Research Initiative, Behavioral and Social Science
Journal Title
Proceedings of the 2016 ACM Multimedia Conference
Conference Name
ACM Multimedia Conference 2016
Journal ISSN
Volume Title
Publisher
Association for Computing Machinery
Sponsorship
Engineering and Physical Sciences Research Council (EP/L00416X/1)