Preserving Vietnam’s cultural heritage, particularly its traditional musical instruments, presents unique challenges and opportunities in the digital age. This paper introduces “ViTIP”, a pioneering framework leveraging artificial intelligence for conservation efforts. Addressing a gap in current research, ViTIPs initiates with the development of models to detect and localize instrument positions (object detection, i.e., Yolo) from self-collected image data. Machine learning algorithms are then applied to refine these models for accurate classification. To enhance accessibility and understanding, 3D models of each instrument type are meticulously crafted, offering immersive visualizations to users. Complementing these efforts, a lightweight ontology based on description logic enriches the contextual information associated with each instrument. A dedicated web platform has been launched to showcase and deploy these innovations. All dataset and implementations are openly shared on GitHub, fostering collaboration and further advancements in cultural preservation technologies. This interdisciplinary approach not only preserves the legacy of Vietnam’s traditional musical instruments but also paves the way for future innovations in cultural heritage conservation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

ViTIP: AI-Powered Vietnamese Traditional Instrument Preservation System Using 3D Space

  • Thanh Ma,
  • Hieu Nguyen,
  • Ky Nguyen,
  • Xuan Nguyen,
  • Thanh-Nghi Do

摘要

Preserving Vietnam’s cultural heritage, particularly its traditional musical instruments, presents unique challenges and opportunities in the digital age. This paper introduces “ViTIP”, a pioneering framework leveraging artificial intelligence for conservation efforts. Addressing a gap in current research, ViTIPs initiates with the development of models to detect and localize instrument positions (object detection, i.e., Yolo) from self-collected image data. Machine learning algorithms are then applied to refine these models for accurate classification. To enhance accessibility and understanding, 3D models of each instrument type are meticulously crafted, offering immersive visualizations to users. Complementing these efforts, a lightweight ontology based on description logic enriches the contextual information associated with each instrument. A dedicated web platform has been launched to showcase and deploy these innovations. All dataset and implementations are openly shared on GitHub, fostering collaboration and further advancements in cultural preservation technologies. This interdisciplinary approach not only preserves the legacy of Vietnam’s traditional musical instruments but also paves the way for future innovations in cultural heritage conservation.