Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Detecting deception using machine learning with facial expressions and pulse rate
Tsuchiya K., Hatano R., Nishiyama H. Artificial Life and Robotics28 (3):509-519,2023.Type:Article
Date Reviewed: Dec 8 2023

This is a very important paper because it combines machine learning, facial expressions analysis, and pulse rate in order to detect deception in an interview context. The results are supported by strong machine learning validation settings, applying cross validation and F1 scores. Additionally, the authors build a data benchmark based on webcam footage and wearable devices (for example, a smartwatch with pulse rate sensing).

What I like most about this paper is the authors’ feature extraction methodology that relies on OpenFace [1] landmarks and the subject’s eyes. For instance, the distance between eyebrows and eyes (right and left), facial contour (for example, head position), and the mouth area are essential in this regard. Gaze has noticeable influence in the methodology, too. It should also be noted that the authors took bias into consideration when removing missing values and outliers in their study.

The paper is well organized and very clear to read. Notably, the random forest machine learning classifier that was implemented achieved promising results (that is, in the range of 80 percent classification accuracy).

I would recommend this paper for researchers in the field of image processing, machine learning, and affective computing (for example, deception detection), as well as a more general computer science (CS) audience. It is very significant and beneficial in its outcome and methodology, in addition to being a fun read.

Reviewer:  Mario Antoine Aoun Review #: CR147674
1) Baltrusaitis, T.; Zadeh, A.; Lim, Y. C.; Morency, L.-P. OpenFace 2.0: facial behavior analysis toolkit. In 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) IEEE, 2018,
Bookmark and Share
  Featured Reviewer  
Learning (I.2.6 )
Artificial, Augmented, And Virtual Realities (H.5.1 ... )
Would you recommend this review?
Other reviews under "Learning": Date
Learning in parallel networks: simulating learning in a probabilistic system
Hinton G. (ed) BYTE 10(4): 265-273, 1985. Type: Article
Nov 1 1985
Macro-operators: a weak method for learning
Korf R. Artificial Intelligence 26(1): 35-77, 1985. Type: Article
Feb 1 1986
Inferring (mal) rules from pupils’ protocols
Sleeman D.  Progress in artificial intelligence (, Orsay, France,391985. Type: Proceedings
Dec 1 1985

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy