MediVerse: AI-Powered Interactive Voice-Driven Virtual Reality for Health Data Analytics
摘要
Biomedical data is increasingly complex, and existing interfaces often fall short in supporting intuitive, immersive exploration. We present MediVerse, a novel edge-cloud architecture that integrates voice-based natural language interfaces, immersive virtual reality (VR) visualization, and large language model (LLM)-based query translation to enable real-time, hands-free interaction with complex biomedical datasets. MediVerse leverages head-mounted VR displays for voice input, cloud-based orchestration for query interpretation and generation, and real-time 3D data rendering in an immersive environment. We demonstrate the platform through two case studies with biomedical data and evaluate its performance across 20 seed based queries. Our findings highlight the system’s ability to accurately interpret user intent, maintain low-latency responsiveness, and deliver immersive, context-aware visualizations, serving as feasibility evidence rather than generalizable performance estimates This work introduces a reusable, modular framework that enhances voice-driven, LLM-assisted biomedical analytics in VR and lays the foundation for next-generation immersive data systems.