Navigating beyond sight: a real-time 3D audio-enhanced object detection system for empowering visually impaired spatial awareness
摘要
Navigating complex environments poses a significant challenge for visually impaired individuals who often rely on traditional aids such as guide dogs and white canes. This aids in the lack of real-time, precise spatial feedback. This paper proposes an advanced place recognition system that utilizes YOLO-based object detection and 3D audio feedback to enhance spatial awareness. The system provides a portable camera and deep-learning algorithms to detect nearby objects and generate spatialized audio cues that guide users safely. The results show an improvement in object recognition accuracy, with the Enhanced YOLO with Attention model achieving 91% accuracy, surpassing the baseline YOLO model by 10%. Additionally, the proposed system demonstrates robustness in occluded environments, with only a 6% performance drop under 30% occlusion compared to 15.5% in the baseline model. User evaluations indicated improved usability, with an easy-to-use rating of 4.8 and Feedback Clarity of 4.7 on a 5-point scale, supporting the effectiveness of the 3D audio approach for independent navigation. These results suggest that the proposed system provides significant enhancement in accessibility, allowing visually impaired individuals to navigate with greater confidence.