Creating believable virtual humans with dynamic emotions, personality-driven behavior, and expressive facial animations is essential for immersive virtual experiences. Traditional scripted approaches often result in rigid and predictable interactions, limiting realism. This paper presents MoodyNPCs, an AI-driven framework that enhances the believability of virtual humans by integrating personality modeling, emotional dynamics, and real-time facial expression synthesis. The system leverages the Big Five personality model [8] and Plutchik’s emotion wheel [19] to create nuanced emotional responses that evolve based on player interactions. Emotional states are continuously updated and influence both dialogue and facial expressions, modeled using Ekman’s Facial Action Coding System (FACS) [4] to ensure realistic representation. By dynamically blending primary emotions and adjusting their intensity, the system enables virtual humans to display more fluid and context-aware reactions. Additionally, a Large Language Model (LLM) generates adaptive dialogues that reflect the character’s emotional state and personality. The framework was tested in both Virtual Reality (VR) and non-VR environments, demonstrating that expressive facial animations significantly enhance perceived realism, with VR increasing immersion and emotional engagement. Future developments will refine emotional transitions and expand expressivity through gestures, voice modulation, and environmental interactions to create more lifelike virtual humans.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MoodyNPC: Personality and Facial Expressions for Virtual Humans

  • Francesco Martinelli,
  • Laura Anna Ripamonti,
  • Nunzio Alberto Borghese,
  • Francesco Bultrini,
  • Andrea Zaniboni

摘要

Creating believable virtual humans with dynamic emotions, personality-driven behavior, and expressive facial animations is essential for immersive virtual experiences. Traditional scripted approaches often result in rigid and predictable interactions, limiting realism. This paper presents MoodyNPCs, an AI-driven framework that enhances the believability of virtual humans by integrating personality modeling, emotional dynamics, and real-time facial expression synthesis. The system leverages the Big Five personality model [8] and Plutchik’s emotion wheel [19] to create nuanced emotional responses that evolve based on player interactions. Emotional states are continuously updated and influence both dialogue and facial expressions, modeled using Ekman’s Facial Action Coding System (FACS) [4] to ensure realistic representation. By dynamically blending primary emotions and adjusting their intensity, the system enables virtual humans to display more fluid and context-aware reactions. Additionally, a Large Language Model (LLM) generates adaptive dialogues that reflect the character’s emotional state and personality. The framework was tested in both Virtual Reality (VR) and non-VR environments, demonstrating that expressive facial animations significantly enhance perceived realism, with VR increasing immersion and emotional engagement. Future developments will refine emotional transitions and expand expressivity through gestures, voice modulation, and environmental interactions to create more lifelike virtual humans.