Show simple item record

dc.contributor.authorMahmoud, Marwaen
dc.contributor.authorBaltrušaitis, Tadasen
dc.contributor.authorRobinson, Peteren
dc.date.accessioned2015-09-07T11:46:42Z
dc.date.available2015-09-07T11:46:42Z
dc.date.issued2014-11-12en
dc.identifier.citationACM Transactions on Interactive Intelligent Systems 2014, 319-326. doi:10.1145/2663204.2663258en
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/250519
dc.description.abstractOne of the main factors that limit the accuracy of facial analysis systems is hand occlusion. As the face becomes occluded, facial features are either lost, corrupted or erroneously detected. Hand-over-face occlusions are considered not only very common but also very challenging to handle. However, there is empirical evidence that some of these hand-over-face gestures serve as cues for recognition of cognitive mental states. In this paper, we present an analysis of automatic detection and classification of hand-over-face gestures. We detect hand-over-face occlusions and classify hand-over-face gesture descriptors in videos of natural expressions using multi-modal fusion of different state-of-the-art spatial and spatio-temporal features. We show experimentally that we can successfully detect face occlusions with an accuracy of 83%. We also demonstrate that we can classify gesture descriptors (hand shape, hand action and facial region occluded) significantly better than a naïve baseline. Our detailed quantitative analysis sheds some light on the challenges of automatic classification of hand-over-face gestures in natural expressions.
dc.description.sponsorshipThe research leading to these results has received partial funding from the European Community’s Seventh Framework Programme (FP7/2007-2013) under grant agreement number 289021 (ASC-Inclusion). We would like also to thank Yousef Jameel and Qualcomm for providing funding as well.
dc.languageEnglishen
dc.language.isoenen
dc.publisherACM
dc.subjectface touchesen
dc.subjectgesturesen
dc.subjectspatio-temporal featuresen
dc.titleAutomatic analysis of naturalistic hand-over-face gesturesen
dc.title.alternativeAutomatic Detection of Naturalistic Hand-over-Face Gesture Descriptorsen
dc.typeConference Object
dc.description.versionThis is the author accepted manuscript. The final version is available from ACM via http://dx.doi.org/10.1145/2663204.2663258en
prism.endingPage326
prism.publicationDate2014en
prism.publicationNameACM Transactions on Interactive Intelligent Systemsen
prism.startingPage319
rioxxterms.versionofrecord10.1145/2663204.2663258en
rioxxterms.licenseref.urihttp://www.rioxx.net/licenses/all-rights-reserveden
rioxxterms.licenseref.startdate2014-11-12en
dc.contributor.orcidRobinson, Peter [0000-0003-0347-3789]
rioxxterms.typeConference Paper/Proceeding/Abstracten


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record