<p>The use of semantics in immersive environments such as Virtual Reality (VR) and Augmented Reality (AR) offers new opportunities to enhance user interaction through multimodal interfaces, including gestures and voice commands. However, significant challenges persist due to the lack of formal and explicit semantic representations of both interaction contexts and virtual scene content. This paper offers a comprehensive review of current methods for integrating semantic data into virtual environments, with a focus on knowledge representation and rule-based reasoning. Using the PRISMA guidelines for systematic reviews, our analysis spans various applications, including science, education, and architecture in virtual and augmented environments. We explore the role of ontologies and knowledge representation in managing virtual environments, emphasizing how knowledge graphs and rule-based reasoning can improve the efficiency and comprehension of user interactions, particularly in generating multimodal commands. This paper identifies research gaps and proposes future directions for developing adaptable and interoperable semantic frameworks that can be reused across diverse virtual environment applications.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An overview study on the use of Semantics in Immersive Environments

  • Nicolas Saint-Léger,
  • Nicolas Férey,
  • Joe Raad,
  • Patrick Bourdot

摘要

The use of semantics in immersive environments such as Virtual Reality (VR) and Augmented Reality (AR) offers new opportunities to enhance user interaction through multimodal interfaces, including gestures and voice commands. However, significant challenges persist due to the lack of formal and explicit semantic representations of both interaction contexts and virtual scene content. This paper offers a comprehensive review of current methods for integrating semantic data into virtual environments, with a focus on knowledge representation and rule-based reasoning. Using the PRISMA guidelines for systematic reviews, our analysis spans various applications, including science, education, and architecture in virtual and augmented environments. We explore the role of ontologies and knowledge representation in managing virtual environments, emphasizing how knowledge graphs and rule-based reasoning can improve the efficiency and comprehension of user interactions, particularly in generating multimodal commands. This paper identifies research gaps and proposes future directions for developing adaptable and interoperable semantic frameworks that can be reused across diverse virtual environment applications.