Enhancing Text Entry in Mixed Reality with Tangible Feedback
摘要
Text entry stands as a fundamental interaction modality in mixed reality systems. Existing systems usually require users to type on a virtual keyboard displayed in air using their index fingers, i.e., in-air typing (IAT) system. However, this approach diverges from traditional physical keyboards on personal computers in that it lacks haptic feedback and entails substantial arm movements during typing, potentially inducing fatigue over extended periods of use. In this paper, we explore the possibilities of on-hand typing (OHT) in a head-mounted mixed reality system. A virtual keyboard materializes upon the user’s palm, affording the user the ability to input text upon their own hand with tangible feedback. Both OHT and IAT systems were both instantiated on the Microsoft HoloLens 2, and their performance was assessed utilizing the standardized MacKenzie phrase set. Furthermore, subjective feedback was garnered via the NASA-Task Load Index Questionnaire and the User Experience Questionnaire. Experimental results reveal that while the OHT system exhibits a slower typing velocity, it entails a notably reduced physical exertion in comparison to the IAT system. This work opens a new pathway for merging virtual and real environments for text input in future mixed reality systems.