Biomedical data is increasingly complex, and existing interfaces often fall short in supporting intuitive, immersive exploration. We present MediVerse, a novel edge-cloud architecture that integrates voice-based natural language interfaces, immersive virtual reality (VR) visualization, and large language model (LLM)-based query translation to enable real-time, hands-free interaction with complex biomedical datasets. MediVerse leverages head-mounted VR displays for voice input, cloud-based orchestration for query interpretation and generation, and real-time 3D data rendering in an immersive environment. We demonstrate the platform through two case studies with biomedical data and evaluate its performance across 20 seed based queries. Our findings highlight the system’s ability to accurately interpret user intent, maintain low-latency responsiveness, and deliver immersive, context-aware visualizations, serving as feasibility evidence rather than generalizable performance estimates This work introduces a reusable, modular framework that enhances voice-driven, LLM-assisted biomedical analytics in VR and lays the foundation for next-generation immersive data systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MediVerse: AI-Powered Interactive Voice-Driven Virtual Reality for Health Data Analytics

  • Rani Adam,
  • Daniel R. Catchpoole,
  • Simeon J. Simoff,
  • Zhonglin Qu,
  • Paul J. Kennedy,
  • Quang Vinh Nguyen

摘要

Biomedical data is increasingly complex, and existing interfaces often fall short in supporting intuitive, immersive exploration. We present MediVerse, a novel edge-cloud architecture that integrates voice-based natural language interfaces, immersive virtual reality (VR) visualization, and large language model (LLM)-based query translation to enable real-time, hands-free interaction with complex biomedical datasets. MediVerse leverages head-mounted VR displays for voice input, cloud-based orchestration for query interpretation and generation, and real-time 3D data rendering in an immersive environment. We demonstrate the platform through two case studies with biomedical data and evaluate its performance across 20 seed based queries. Our findings highlight the system’s ability to accurately interpret user intent, maintain low-latency responsiveness, and deliver immersive, context-aware visualizations, serving as feasibility evidence rather than generalizable performance estimates This work introduces a reusable, modular framework that enhances voice-driven, LLM-assisted biomedical analytics in VR and lays the foundation for next-generation immersive data systems.