A wearable augmented reality system for intelligent maintenance of mechanical equipment
摘要
With the rapid development of intelligent maintenance systems in the context of Industry 4.0, traditional approaches have struggled to address challenges such as non-intuitive information presentation and inefficient human–machine interaction, particularly in dynamic industrial environments. To address these challenges, a wearable augmented reality mechanical equipment intelligent maintenance system (AR-EIMS) was developed. This system leverages AR technology to provide real-time, intuitive equipment status visualization and maintenance suggestions. AR-EIMS integrates three key components: the condition monitoring module, the equipment identification module, and the data visualization module. First, the condition monitoring module combines with a vibration-based equipment monitoring and maintenance system to facilitate decision-making. This module acquires and automatically processes sensor data (e.g., acceleration, current), assesses equipment health status, and stores processed metrics in a database. Second, the equipment identification module runs YOLOv11 on a server to process image data from the AR glasses’ camera, enabling accurate detection of target equipment. Third, the data visualization module projects key equipment metrics into the user’s field of view (FOV) for real-time information delivery. In addition, the study proposes a method that integrates YOLOv11 with coordinate transformation to enable real‑time tracking and visualization of equipment positions on the AR display. The prototype system was validated in a mechanical equipment condition monitoring laboratory with 51 participants. The user study confirmed that AR-EIMS streamlined the equipment patrol inspection process and enhanced the overall efficiency of maintenance workflows, offering a novel solution for intelligent maintenance.