OpenFace: An open source facial behavior analysis toolkit


Type
Conference Object
Change log
Authors
Baltrusaitis, Tadas 
Morency, Louis-Philippe 
Abstract

Over the past few years, there has been an increased interest in automatic facial behavior analysis and understanding. We present OpenFace – an open source tool intended for computer vision and machine learning researchers, affective computing community and people interested in building interactive applications based on facial behavior analysis. OpenFace is the first open source tool capable of facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. The computer vision algorithms which represent the core of OpenFace demonstrate state-of-the-art results in all of the above mentioned tasks. Furthermore, our tool is capable of real-time performance and is able to run from a simple webcam without any specialist hardware. Finally, OpenFace allows for easy integration with other applications and devices through a lightweight messaging system.

Description
Keywords
46 Information and Computing Sciences, 4608 Human-Centred Computing
Journal Title
2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
Conference Name
2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
Journal ISSN
Volume Title
Publisher
IEEE
Sponsorship
European Community Seventh Framework Programme (FP7/2007-2013) under grant agreement No. 289021 (ASC-Inclusion).