Scholarlink

<p>Effective development of virtual reality (VR) applications is heavily reliant on the evaluation of user experience (UX). However, traditional methods such as questionnaires have inherent limitations which hinder their ability to capture nuanced behavioral responses and impede the agility of VR content creation: They are time-consuming, burdensome for users, and require significant human effort for interpretation. This study introduces an automated framework aimed at addressing the limitations of questionnaire-based evaluations to assess UX in VR. Our primary focus is to validate the concept of this framework through assessment of the sense of presence (SOP), a crucial psychological perception with significant impact on VR UX. Our proposed framework utilizes a deep neural network (DNN) to analyze patterns in multimodal behavioral cues, including facial expressions, head movements, and hand movements, to predict scores from the Igroup Presence Questionnaire (IPQ). Additionally, we introduce two statistical profiles: the Visual Entropy Profile (VEP), which offers insights into visual complexity by depicting scene entropy, and the Experiential Presence Profile (EPP), which is designed to capture users’ historical SOP levels to enable personalized baseline and sensitivity estimation. The proposed framework achieves a significant correlation between actual and predicted IPQ scores, with a Spearman’s rank correlation coefficient of 0.7303, showcasing the potential of DNNs in analyzing complex behavioral signals and automating SOP assessment. This study represents a pioneering effort in leveraging DNNs for the automatic assessment of SOP and paves the way for future advances in automatically assessing VR UX and unlocking new opportunities in the field.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A deep learning framework for automatic assessment of presence in virtual reality using multimodal behavioral cues

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年1月11日

查看全文
  • Peerawat Pannattee,
  • Shogo Shimada,
  • Vibol Yem,
  • Nobuyuki Nishiuchi

摘要

Effective development of virtual reality (VR) applications is heavily reliant on the evaluation of user experience (UX). However, traditional methods such as questionnaires have inherent limitations which hinder their ability to capture nuanced behavioral responses and impede the agility of VR content creation: They are time-consuming, burdensome for users, and require significant human effort for interpretation. This study introduces an automated framework aimed at addressing the limitations of questionnaire-based evaluations to assess UX in VR. Our primary focus is to validate the concept of this framework through assessment of the sense of presence (SOP), a crucial psychological perception with significant impact on VR UX. Our proposed framework utilizes a deep neural network (DNN) to analyze patterns in multimodal behavioral cues, including facial expressions, head movements, and hand movements, to predict scores from the Igroup Presence Questionnaire (IPQ). Additionally, we introduce two statistical profiles: the Visual Entropy Profile (VEP), which offers insights into visual complexity by depicting scene entropy, and the Experiential Presence Profile (EPP), which is designed to capture users’ historical SOP levels to enable personalized baseline and sensitivity estimation. The proposed framework achieves a significant correlation between actual and predicted IPQ scores, with a Spearman’s rank correlation coefficient of 0.7303, showcasing the potential of DNNs in analyzing complex behavioral signals and automating SOP assessment. This study represents a pioneering effort in leveraging DNNs for the automatic assessment of SOP and paves the way for future advances in automatically assessing VR UX and unlocking new opportunities in the field.