Existing research has struggled with limited precision in segmenting the human eye’s pupil and iris due to factors such as occlusion and varying lighting conditions. Facing the challenged mentioned above we propose a network model based on an improved U-Net with an attention mechanism for fine segmentation of the human pupil and iris in natural scenes. The model employs the U-Net structure as its foundation, replacing the backbone with VGG16 to enhance semantic feature extraction capabilities. Additionally, the attention mechanism is used which enables the model to focus on regions of interest while suppressing irrelevant information. Six representative objects were selected from the GazeCapture dataset for pre-processing. The proposed model effectively handles partial eye occlusion, makeup, and lighting variations. Experimental results demonstrate that our method achieved a mean pixel accuracy (mPA) of 95.19% for pupil and iris segmentation, surpassing the classical U-Net’s accuracy of 90%. Moreover, the mean Intersection over Union (mIoU) reached 90.03%, outperforming the classical U-Net model’s mIoU of 83%.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Pupil and Iris Segmentation Method Based on Improved U-Net with Attention Mechanism

  • Ruyu Yan,
  • Lin Li,
  • Xinmei Wu

摘要

Existing research has struggled with limited precision in segmenting the human eye’s pupil and iris due to factors such as occlusion and varying lighting conditions. Facing the challenged mentioned above we propose a network model based on an improved U-Net with an attention mechanism for fine segmentation of the human pupil and iris in natural scenes. The model employs the U-Net structure as its foundation, replacing the backbone with VGG16 to enhance semantic feature extraction capabilities. Additionally, the attention mechanism is used which enables the model to focus on regions of interest while suppressing irrelevant information. Six representative objects were selected from the GazeCapture dataset for pre-processing. The proposed model effectively handles partial eye occlusion, makeup, and lighting variations. Experimental results demonstrate that our method achieved a mean pixel accuracy (mPA) of 95.19% for pupil and iris segmentation, surpassing the classical U-Net’s accuracy of 90%. Moreover, the mean Intersection over Union (mIoU) reached 90.03%, outperforming the classical U-Net model’s mIoU of 83%.