<p>Video-based deception detection, which identifies lies through facial expressions and behaviors, has proven to be an effective approach in criminal interrogation. In this paper, a deception detection framework is proposed that incorporates a novel set of features and a unique deception detection method based on facial expressions, particularly micro-expressions. Two feature selection methods are applied to optimize these features. Specifically, facial action units (AUs), eye gaze, and head pose were extracted using the OpenFace toolkit, while micro-expression information was obtained via the SOFTNet model, trained on the CAS(ME)<InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="13640_2025_674_Article_IEq1.gif" Format="GIF" Height="10" Rendition="HTML" Resolution="72" Type="Linedraw" Width="8" /> </InlineMediaObject> <EquationSource Format="TEX">\(^{2}\)</EquationSource> <EquationSource Format="MATHML"><math> <mmultiscripts> <mrow /> <mrow /> <mn>2</mn> </mmultiscripts> </math></EquationSource> </InlineEquation> data set. A sequential combination of the Fischer Score and Principal Component Analysis (PCA) was employed for feature selection, with a Support Vector Machine (SVM) used for classification. Feature importance analysis indicated that micro-expression (ME) information had a significant impact on the deception detection task. The proposed framework was evaluated on two publicly available data sets, achieving accuracies of 98.07% and 98.23% on the real-life and MU3D data sets, respectively, thus demonstrating its superiority over prior approaches in the literature.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Deception detection based on micro-expression and feature selection methods

  • Shusen Yuan,
  • Zilong Shao,
  • Zhongjun Ma,
  • Ting Cao,
  • Hongbo Xing,
  • Yong Liu,
  • Yewen Cao

摘要

Video-based deception detection, which identifies lies through facial expressions and behaviors, has proven to be an effective approach in criminal interrogation. In this paper, a deception detection framework is proposed that incorporates a novel set of features and a unique deception detection method based on facial expressions, particularly micro-expressions. Two feature selection methods are applied to optimize these features. Specifically, facial action units (AUs), eye gaze, and head pose were extracted using the OpenFace toolkit, while micro-expression information was obtained via the SOFTNet model, trained on the CAS(ME) \(^{2}\) 2 data set. A sequential combination of the Fischer Score and Principal Component Analysis (PCA) was employed for feature selection, with a Support Vector Machine (SVM) used for classification. Feature importance analysis indicated that micro-expression (ME) information had a significant impact on the deception detection task. The proposed framework was evaluated on two publicly available data sets, achieving accuracies of 98.07% and 98.23% on the real-life and MU3D data sets, respectively, thus demonstrating its superiority over prior approaches in the literature.