Show simple item record

dc.contributor.authorMambreyan, Ara
dc.contributor.authorPunskaya, Elena
dc.contributor.authorGunes, Hatice
dc.date.accessioned2022-06-22T23:30:06Z
dc.date.available2022-06-22T23:30:06Z
dc.identifier.urihttps://www.repository.cam.ac.uk/handle/1810/338298
dc.description.abstractWith the advances in Machine Learning, lie detection technology gained significant attention. In recent years, several multi-modal techniques achieved as high as 99% accuracy results using the Real-life Trial dataset with only 121 data points. This led to considerable media hype and research interest in lie detection with machine learning. In this paper, we analyze the effect of dataset bias in deception detection. More specifically, we train a classifier to predict the sex of the identity appearing in the video. On a test data point, we use the sex predictor to predict sex which we use as a proxy for predicting deception, predicting lie for females and truth for males. This lie predictor simulates a classifier that uses nothing but dataset bias. Nevertheless, we find that the performance of this biased classifier is comparable to those of state-of-the-art papers. More specifically, when using IDT features, our biased classifier achieves 64.6% and 59.3% AUC while a classifier trained normally on truth/lie labels achieves 57.4% accuracy and 69.3% AUC. We perform similar experiments on the Bag-of-Lies dataset and show that it too is biased with respect to sex. In addition, we apply the state-of- the-art techniques on an unbiased dataset and show that their performance is no better than chance. Our experiments strongly suggest that the results of recent deception detection techniques can be explained by the bias inherent in the datasets.
dc.rightsAttribution 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleDataset Bias in Deception Detection
dc.typeConference Object
dc.publisher.departmentDepartment of Computer Science And Technology
dc.date.updated2022-06-15T20:17:41Z
prism.publicationNameProceedings of the 26th International Conference on Pattern Recognition
dc.identifier.doi10.17863/CAM.85707
dcterms.dateAccepted2022-05-17
rioxxterms.versionofrecord10.17863/CAM.85707
rioxxterms.versionAM
dc.contributor.orcidGunes, Hatice [0000-0003-2407-3012]
pubs.funder-project-idEngineering and Physical Sciences Research Council (EP/R030782/1)
pubs.funder-project-idEuropean Commission Horizon 2020 (H2020) Societal Challenges (826232)
pubs.conference-nameThe 26th International Conference on Pattern Recognition
pubs.conference-start-date2022-08-21
cam.depositDate2022-06-15
pubs.conference-finish-date2022-08-25
pubs.licence-identifierapollo-deposit-licence-2-1
pubs.licence-display-nameApollo Repository Deposit Licence Agreement


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record

Attribution 4.0 International
Except where otherwise noted, this item's licence is described as Attribution 4.0 International