<p>Eye-tracking signals such as pupil diameter and gaze behavior have been widely used for stress detection, yet most approaches rely on task-specific features, controlled laboratory settings, or multimodal sensor combinations, limiting scalability in less controlled environments. This work investigates whether unimodal eye-tracking time-series data can support task-agnostic stress detection beyond static laboratory tasks. We analyze stress classification across two complementary datasets: a virtual reality goalkeeper task with moderate visuomotor activity and stable recording conditions, and a virtual job interview dataset reflecting less controlled settings with uncalibrated signals. The results show that these signals alone contain informative patterns related to stress-associated autonomic and oculomotor responses. Under favorable conditions, performance reaches up to <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\({95.98}\%\)</EquationSource> </InlineEquation> macro-averaged F1-score. At the same time, performance varies substantially across datasets, indicating that effective learning depends strongly on data quality, calibration, signal characteristics, and task design. Overall, the findings demonstrate the potential of unimodal eye tracking as a lower-burden alternative to more complex multimodal systems, while highlighting that reliable stress detection is fundamentally conditioned by the interplay of data, signal representation, and modeling approach.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Classifying mental stress from eye tracking data: deep learning approaches for out-of-the-lab conditions

  • Maike Laut,
  • Eva Dorschky,
  • Robert Richer,
  • Nicolas Rohleder,
  • Bjoern M. Eskofier

摘要

Eye-tracking signals such as pupil diameter and gaze behavior have been widely used for stress detection, yet most approaches rely on task-specific features, controlled laboratory settings, or multimodal sensor combinations, limiting scalability in less controlled environments. This work investigates whether unimodal eye-tracking time-series data can support task-agnostic stress detection beyond static laboratory tasks. We analyze stress classification across two complementary datasets: a virtual reality goalkeeper task with moderate visuomotor activity and stable recording conditions, and a virtual job interview dataset reflecting less controlled settings with uncalibrated signals. The results show that these signals alone contain informative patterns related to stress-associated autonomic and oculomotor responses. Under favorable conditions, performance reaches up to \({95.98}\%\) macro-averaged F1-score. At the same time, performance varies substantially across datasets, indicating that effective learning depends strongly on data quality, calibration, signal characteristics, and task design. Overall, the findings demonstrate the potential of unimodal eye tracking as a lower-burden alternative to more complex multimodal systems, while highlighting that reliable stress detection is fundamentally conditioned by the interplay of data, signal representation, and modeling approach.