<p>Obstacle detection remains vital in autonomous navigation and assistive technologies, especially for visually impaired individuals. This work introduces an enhanced obstacle detection framework based on a Bilateral Vision Transformer and Convolution Kernel Neural Network (BViT-CKNN). The system incorporates stereo vision data and applies a bilateral filter to reduce noise while preserving edge details. A Vision Transformer (ViT) model is then used for global feature extraction, and a Convolution Kernel Neural Network (CKNN) captures fine-grained local features. Evaluated using the COCO dataset, the proposed BViT-CKNN achieves superior performance in precision (0.93), recall (0.91), F1-score (0.92), and Mean Absolute Error (MAE) reduction (3.16%) compared to existing methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhanced obstacle detection using bilateral vision-aided transformer neural network for visually impaired persons

  • Ala Alarood,
  • Mohammed Salem Atoum,
  • Azizah Abdul Manaf,
  • Adamu Abubakar,
  • Izzat Alsmadi

摘要

Obstacle detection remains vital in autonomous navigation and assistive technologies, especially for visually impaired individuals. This work introduces an enhanced obstacle detection framework based on a Bilateral Vision Transformer and Convolution Kernel Neural Network (BViT-CKNN). The system incorporates stereo vision data and applies a bilateral filter to reduce noise while preserving edge details. A Vision Transformer (ViT) model is then used for global feature extraction, and a Convolution Kernel Neural Network (CKNN) captures fine-grained local features. Evaluated using the COCO dataset, the proposed BViT-CKNN achieves superior performance in precision (0.93), recall (0.91), F1-score (0.92), and Mean Absolute Error (MAE) reduction (3.16%) compared to existing methods.