OpenFace: An open source facial behavior analysis toolkit

Conference Object
Change log
Baltrusaitis, Tadas 
Morency, Louis-Philippe 

Over the past few years, there has been an increased interest in automatic facial behavior analysis and understanding. We present OpenFace – an open source tool intended for computer vision and machine learning researchers, affective computing community and people interested in building interactive applications based on facial behavior analysis. OpenFace is the first open source tool capable of facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. The computer vision algorithms which represent the core of OpenFace demonstrate state-of-the-art results in all of the above mentioned tasks. Furthermore, our tool is capable of real-time performance and is able to run from a simple webcam without any specialist hardware. Finally, OpenFace allows for easy integration with other applications and devices through a lightweight messaging system.

46 Information and Computing Sciences, 4608 Human-Centred Computing
Journal Title
2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
Conference Name
2016 IEEE Winter Conference on Applications of Computer Vision (WACV)
Journal ISSN
Volume Title
European Community Seventh Framework Programme (FP7/2007-2013) under grant agreement No. 289021 (ASC-Inclusion).