Multimodal classification of driver glance
View / Open Files
Authors
Baumann, D
Mahmoud, M
Robinson, P
Dias, E
Skrypchuk, L
Publication Date
2017Journal Title
2017 7th International Conference on Affective Computing and Intelligent Interaction, ACII 2017
Conference Name
2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII)
ISSN
2156-8103
ISBN
9781538605639
Publisher
IEEE
Volume
2018-January
Pages
389-394
Type
Conference Object
Metadata
Show full item recordCitation
Baumann, D., Mahmoud, M., Robinson, P., Dias, E., & Skrypchuk, L. (2017). Multimodal classification of driver glance. 2017 7th International Conference on Affective Computing and Intelligent Interaction, ACII 2017, 2018-January 389-394. https://doi.org/10.1109/ACII.2017.8273629
Abstract
—This paper presents a multimodal approach to invehicle
classification of driver glances. Driver glance is a
strong predictor of cognitive load and is a useful input to
many applications in the automotive domain. Six descriptive
glance regions are defined and a classifier is trained on video
recordings of drivers from a single low-cost camera. Visual
features such as head orientation, eye gaze and confidence
ratings are extracted, then statistical methods are used to
perform failure analysis and calibration on the visual features.
Non-visual features such as steering wheel angle and indicator
position are extracted from a RaceLogic VBOX system. The
approach is evaluated on a dataset containing multiple 60
second samples from 14 participants recorded while driving in
a natural environment. We compare our multimodal approach
to separate unimodal approaches using both Support Vector
Machine (SVM) and Random Forests (RF) classifiers. RF
Mean Decrease in Gini Index is used to rank selected features
which gives insight into the selected features and improves the
classifier performance. We demonstrate that our multimodal
approach yields significantly higher results than unimodal
approaches. The final model achieves an average F1 score of
70.5% across the six classes.
Identifiers
External DOI: https://doi.org/10.1109/ACII.2017.8273629
This record's URL: https://www.repository.cam.ac.uk/handle/1810/280586
Rights
Licence:
http://www.rioxx.net/licenses/all-rights-reserved
Statistics
Total file downloads (since January 2020). For more information on metrics see the
IRUS guide.
Recommended or similar items
The current recommendation prototype on the Apollo Repository will be turned off on 03 February 2023. Although the pilot has been fruitful for both parties, the service provider IKVA is focusing on horizon scanning products and so the recommender service can no longer be supported. We recognise the importance of recommender services in supporting research discovery and are evaluating offerings from other service providers. If you would like to offer feedback on this decision please contact us on: support@repository.cam.ac.uk