Scholarlink

<p>Mixed Reality (MR) technology, as an emerging interactive medium, has seen widespread application in various everyday fields in recent years, offering significant convenience for intelligent interactions between humans and spaces. However, current MR environments primarily rely on single-input interaction methods, where specific behaviors or body movements are recognized to drive changes in the virtual environment. Such approaches often overlook the comprehensive and interrelated nature of human behaviors, potentially diminishing the immersive user experience. This paper proposes an improved interaction model that aims to comprehensively perceive multi-scale human behaviors, including social, global-postural, local-gestural, and facial scales. Using a smart office space as the design prototype, the system integrates body tracking and affective computing techniques, and employs Grasshopper and Unity for real-time spatial modeling and rendering. This allows the MR environment to dynamically respond to user behaviors and support flexible spatial transformations. An experimental study provides initial evidence that the proposed framework can effectively sense user behaviors and dynamically adapt environmental changes. The results suggest potential improvements in spatial immersion and interaction naturalness, providing a reference for further exploration of behavior-driven interaction in intelligent MR environments.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A multilevel computing framework for behavior recognition and interaction in mixed reality workspaces

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年8月4日

查看全文
  • Menghang Liu,
  • Ruyi Yang,
  • Luqi Feng,
  • Yanzi Jin,
  • Wenjie Wang,
  • Chao Yan

摘要

Mixed Reality (MR) technology, as an emerging interactive medium, has seen widespread application in various everyday fields in recent years, offering significant convenience for intelligent interactions between humans and spaces. However, current MR environments primarily rely on single-input interaction methods, where specific behaviors or body movements are recognized to drive changes in the virtual environment. Such approaches often overlook the comprehensive and interrelated nature of human behaviors, potentially diminishing the immersive user experience. This paper proposes an improved interaction model that aims to comprehensively perceive multi-scale human behaviors, including social, global-postural, local-gestural, and facial scales. Using a smart office space as the design prototype, the system integrates body tracking and affective computing techniques, and employs Grasshopper and Unity for real-time spatial modeling and rendering. This allows the MR environment to dynamically respond to user behaviors and support flexible spatial transformations. An experimental study provides initial evidence that the proposed framework can effectively sense user behaviors and dynamically adapt environmental changes. The results suggest potential improvements in spatial immersion and interaction naturalness, providing a reference for further exploration of behavior-driven interaction in intelligent MR environments.