This study presents a framework for integrating agents of generative artificial intelligence (AI) within immersive virtual reality (VR) environments to support high school anatomy education. While traditional tools offer common visual aids or textual descriptions of human anatomy, our approach employs a Unity-based 3D VR simulation, combined with a large language model (LLM)-powered AI instructor, to facilitate interactive, personalized learning. The system enables students to construct and deconstruct a highly comprehensive virtual human body layer by layer, engaging with both internal and external anatomical structures through Mechdyne’s ARC System and various VR headset models. This study also explores the possibility of introducing an AI agent with real-time natural language processing and text-to-speech capabilities, allowing it to respond conversationally to student inquiries and adapt its guidance based on prior knowledge, demographic data, and learning assessments. Another exploration in this paper is the data architecture behind the AI agent, which should record student interactions, question types, and knowledge gaps. This information will be used to fine-tune AI responses via a reinforcement-learning-based personalization layer. The entire system should eventually be evaluated through a mixed-methods study that includes usability testing, pre- and post-knowledge assessments, and student feedback surveys.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Agentic Learning with an AI Instructor in Virtual Reality for High School Anatomy Instruction

  • Robert DeWitty,
  • Koundinya Challa,
  • Abhinav Pendem,
  • Issa W. AlHmoud,
  • Balakrishna Gokaraju

摘要

This study presents a framework for integrating agents of generative artificial intelligence (AI) within immersive virtual reality (VR) environments to support high school anatomy education. While traditional tools offer common visual aids or textual descriptions of human anatomy, our approach employs a Unity-based 3D VR simulation, combined with a large language model (LLM)-powered AI instructor, to facilitate interactive, personalized learning. The system enables students to construct and deconstruct a highly comprehensive virtual human body layer by layer, engaging with both internal and external anatomical structures through Mechdyne’s ARC System and various VR headset models. This study also explores the possibility of introducing an AI agent with real-time natural language processing and text-to-speech capabilities, allowing it to respond conversationally to student inquiries and adapt its guidance based on prior knowledge, demographic data, and learning assessments. Another exploration in this paper is the data architecture behind the AI agent, which should record student interactions, question types, and knowledge gaps. This information will be used to fine-tune AI responses via a reinforcement-learning-based personalization layer. The entire system should eventually be evaluated through a mixed-methods study that includes usability testing, pre- and post-knowledge assessments, and student feedback surveys.