Human–Machine Interactions would significantly benefit from systems capable of predicting human emotions, potentially revolutionizing user experience and outcomes. The ‘PHANTOMATRIX’ project explores the use of Machine Learning (ML) to predict emotional states by analyzing biological signals such as heart rate and facial expressions within Virtual Reality (VR) environments. This study utilizes VR’s immersive capabilities for evoking and measuring emotions through physiological, kinematic, and self-reported data, employing wearables and cameras. Although previous research has highlighted ML’s potential in predicting physiological responses to VR stimuli, the precise indicators of emotion remain elusive to identify due to the subjective nature of emotions and overlapping physiological signs. ‘PHANTOMATRIX’ addresses this by measuring individual emotions across multiple modalities linked to specific VR scenarios, significantly extending current research. The project focuses on the effectiveness of VR environments in eliciting focus and relaxation, correlating physiological responses to VR parameters, and using these parameters in ML models to predict emotional states. The outcomes aim to significantly enhance our understanding of mechanisms for emotion induction, classification, and regulation, with broad implications in societal, educational, and health sectors, particularly improving Human–Machine Interaction.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PHANTOMATRIX: A Framework for Predicting Physiological Reactions in Virtual Reality with Machine Learning

  • Armin Grasnick,
  • Anne Schwerk

摘要

Human–Machine Interactions would significantly benefit from systems capable of predicting human emotions, potentially revolutionizing user experience and outcomes. The ‘PHANTOMATRIX’ project explores the use of Machine Learning (ML) to predict emotional states by analyzing biological signals such as heart rate and facial expressions within Virtual Reality (VR) environments. This study utilizes VR’s immersive capabilities for evoking and measuring emotions through physiological, kinematic, and self-reported data, employing wearables and cameras. Although previous research has highlighted ML’s potential in predicting physiological responses to VR stimuli, the precise indicators of emotion remain elusive to identify due to the subjective nature of emotions and overlapping physiological signs. ‘PHANTOMATRIX’ addresses this by measuring individual emotions across multiple modalities linked to specific VR scenarios, significantly extending current research. The project focuses on the effectiveness of VR environments in eliciting focus and relaxation, correlating physiological responses to VR parameters, and using these parameters in ML models to predict emotional states. The outcomes aim to significantly enhance our understanding of mechanisms for emotion induction, classification, and regulation, with broad implications in societal, educational, and health sectors, particularly improving Human–Machine Interaction.