In this study, we describe the design of a Mixed Reality (MR) portal system with an AI companion. Our system allows the user to enter various virtual portals that are placed in the real world via an MR headset. Each portal contains a virtual world with a different theme and settings. The user can explore and perform activities relating to the virtual world theme. The AI companion will accompany the user and provide guidance. We use Natural Language Processing (NLP) for the AI companion to provide conversational between the user and the AI companion. The user can ask the AI companion about the specific virtual world. In addition, the AI companion is also able to interact with certain objects inside the virtual world. The goal of this MR portal system is to provide an educational application that is interactive and immersive. We provide the initial proof of concept implementation of the system. This study also highlights the technical challenges and solutions in integrating the AI companion that understands the context of each virtual world.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Mixed Reality Portal with Artificial Intelligence Companion

  • Muhamad Haikal Arman,
  • Ajune Wanis Ismail,
  • Muhammad Anwar Ahmad

摘要

In this study, we describe the design of a Mixed Reality (MR) portal system with an AI companion. Our system allows the user to enter various virtual portals that are placed in the real world via an MR headset. Each portal contains a virtual world with a different theme and settings. The user can explore and perform activities relating to the virtual world theme. The AI companion will accompany the user and provide guidance. We use Natural Language Processing (NLP) for the AI companion to provide conversational between the user and the AI companion. The user can ask the AI companion about the specific virtual world. In addition, the AI companion is also able to interact with certain objects inside the virtual world. The goal of this MR portal system is to provide an educational application that is interactive and immersive. We provide the initial proof of concept implementation of the system. This study also highlights the technical challenges and solutions in integrating the AI companion that understands the context of each virtual world.