<p>The metaverse has gained increasing attention with advances in artificial intelligence (AI), semiconductor devices and high-speed networks. Although the metaverse has potential across various industries and consumer markets, it remains in the early stages of development, with further progress in extended reality (XR) technologies anticipated. In this Review, we provide an overview of essential XR technologies for immersive metaverse experiences enabling human–digital interactions. Motion sensing, eye tracking, pose estimation and 3D mapping, scene understanding, digital humans, conversational AI for metaverse non-player characters, motion-to-photon latency compensation and optical display systems are important for human–digital interaction in the metaverse, with AI accelerating the evolution of these technologies. Key challenges include the accuracy and robustness of sensing and recognition of users and surrounding environments, real-time content generation reflecting the users’ responses and environments, and high-performance XR head-mounted displays with compact form factors. Realizing this potential will enable people to interact more genuinely with each other and digital objects in healthcare, education, retail, manufacturing and everyday life.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Extended reality technologies for applications in the metaverse

  • Hiroshi Mukawa,
  • Yoichi Hirota,
  • Hiroki Mizuno,
  • Makoto Murata,
  • Fuminori Homma,
  • Keita Mochizuki,
  • Ryo Ogawa,
  • Yuki Mamishin,
  • Hiroyuki Aga,
  • Jun Yokono,
  • Daiki Shimada,
  • Masaki Fukuchi

摘要

The metaverse has gained increasing attention with advances in artificial intelligence (AI), semiconductor devices and high-speed networks. Although the metaverse has potential across various industries and consumer markets, it remains in the early stages of development, with further progress in extended reality (XR) technologies anticipated. In this Review, we provide an overview of essential XR technologies for immersive metaverse experiences enabling human–digital interactions. Motion sensing, eye tracking, pose estimation and 3D mapping, scene understanding, digital humans, conversational AI for metaverse non-player characters, motion-to-photon latency compensation and optical display systems are important for human–digital interaction in the metaverse, with AI accelerating the evolution of these technologies. Key challenges include the accuracy and robustness of sensing and recognition of users and surrounding environments, real-time content generation reflecting the users’ responses and environments, and high-performance XR head-mounted displays with compact form factors. Realizing this potential will enable people to interact more genuinely with each other and digital objects in healthcare, education, retail, manufacturing and everyday life.