Cross-System Virtual Reality (VR) Authentication Using Transformer-Based Trajectory Forecasting
摘要
Ubiquitous devices, such as smartphones and tablets, have pervaded critical applications in education, healthcare, and military, with users having systems for their home, office, clinic, or job site. As virtual reality (VR) systems become more affordable, they are likely to gain similar multi-system adoption in critical applications where sensitive user data must be protected from malicious users. Recent work has shown that deep learning techniques are usable for cross-system authentication where enrollment data is provided in one system, e.g. an HTC Vive, and use time data on another, e.g. a Meta Quest. However, these approaches require complete or near complete trajectories of user behavior and show lower performance when smaller portions of user behavior from the start of the activity are used. In prior work, motion forecasting has been used to predict future motion and use it for VR authentication. However, this work works on a single VR system, and requires a distinct authentication model per user. We present the first generalized authentication framework for cross-system VR biometrics using a forecasting neural network based on the Transformer, and an authentication neural network based on a fully convolutional network. To validate our approach, we use a publicly available dataset that provides motion trajectories from a ball-throwing task using multiple VR systems. We show that our approach reduces the equal error rate (EER) by an average of 53.16% across all VR system combinations when compared to existing state-of-the-art approaches on cross-VR-system authentication. Our approach enables interoperability across VR systems that use lighthouse- and camera-based tracking and provides early authentication without requiring the full user trajectory. Link to code: https://bit.ly/44DafAD .