The aim of this study is to optimize an app for AR glasses that translates text-based signs, such as road signs and billboards, into a desired language in real time. With the release of devices like XREAL Air, Apple Vision Pro, and Meta Quest 3, AR technology has shown great potential for daily use. However, market research reveals high return rates due to a lack of engaging content. To address this, the project leverages AR’s unique strengths by developing a real-time translation service to assist travelers in reading foreign text. It incorporates a gesture-based communication system, a history-based search algorithm for quick word processing, and a content management algorithm for unused text. The app overlays translated text on the original in the user's view. Trials with 15 users assess the system's convenience and demonstrate its ability to enhance AR’s viability in everyday life.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Optimizing Real-Time Translation for AR Glasses: Enhancing Usability through Gesture and Content Algorithm

  • Bokwang Shim,
  • Suhyeon Seo,
  • Sungil Oh,
  • Yangkyu Lim

摘要

The aim of this study is to optimize an app for AR glasses that translates text-based signs, such as road signs and billboards, into a desired language in real time. With the release of devices like XREAL Air, Apple Vision Pro, and Meta Quest 3, AR technology has shown great potential for daily use. However, market research reveals high return rates due to a lack of engaging content. To address this, the project leverages AR’s unique strengths by developing a real-time translation service to assist travelers in reading foreign text. It incorporates a gesture-based communication system, a history-based search algorithm for quick word processing, and a content management algorithm for unused text. The app overlays translated text on the original in the user's view. Trials with 15 users assess the system's convenience and demonstrate its ability to enhance AR’s viability in everyday life.