Laparoscopic augmented reality (LAR) enables real-time visualization of internal organ anatomy, effectively reducing surgical risks. Rigid point cloud registration aligns the spatial position of the preoperative image point cloud with the intraoperative laparoscopic video point cloud, playing a pivotal role in the virtual-real fusion visualization for LAR. However, the limited field of view in laparoscopic surgery results in only partial visibility of the organ. This leads to an incomplete video point cloud that exhibits low overlap with the image point cloud, rendering registration highly susceptible to local optima. Moreover, the smooth and texture-deficient organ surface makes popular superpoint matching methods based on feature similarity ineffective. Inspired by the highly consistent morphology of the video and image point clouds at organ bottom edges, we propose an edge guidance (EG) mechanism to address the challenge of sparse surface features in laparoscopic scenes. The EG mechanism identifies edge points by calculating the standard deviation of correlations among neighboring points, prioritizes edge alignment, and subsequently guides the matching of other points. We leverage this mechanism to develop an edge-guided rigid point cloud registration network, EG-Net. Compared with the state-of-the-art method PARE-Net, EG-Net achieves at least a 7% improvement in accuracy and an 11% increase in speed across three laparoscopic datasets: the public DePoLL dataset, a pig liver surgery dataset, and a human liver surgery dataset. With its high accuracy, fast speed, and strong generalization, EG-Net holds significant potential for clinical applications in laparoscopic surgery. The code is available at: https://github.com/FDC-WuWeb/EG-Net .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

EG-Net: An Edge-Guided Network for Rigid Registration of Laparoscopic Low-Overlap Point Clouds

  • Wenbin Wu,
  • Yifan Gao,
  • Yixiu Wang,
  • Jiayi Zhang,
  • Yiming Zhao,
  • Xin Gao

摘要

Laparoscopic augmented reality (LAR) enables real-time visualization of internal organ anatomy, effectively reducing surgical risks. Rigid point cloud registration aligns the spatial position of the preoperative image point cloud with the intraoperative laparoscopic video point cloud, playing a pivotal role in the virtual-real fusion visualization for LAR. However, the limited field of view in laparoscopic surgery results in only partial visibility of the organ. This leads to an incomplete video point cloud that exhibits low overlap with the image point cloud, rendering registration highly susceptible to local optima. Moreover, the smooth and texture-deficient organ surface makes popular superpoint matching methods based on feature similarity ineffective. Inspired by the highly consistent morphology of the video and image point clouds at organ bottom edges, we propose an edge guidance (EG) mechanism to address the challenge of sparse surface features in laparoscopic scenes. The EG mechanism identifies edge points by calculating the standard deviation of correlations among neighboring points, prioritizes edge alignment, and subsequently guides the matching of other points. We leverage this mechanism to develop an edge-guided rigid point cloud registration network, EG-Net. Compared with the state-of-the-art method PARE-Net, EG-Net achieves at least a 7% improvement in accuracy and an 11% increase in speed across three laparoscopic datasets: the public DePoLL dataset, a pig liver surgery dataset, and a human liver surgery dataset. With its high accuracy, fast speed, and strong generalization, EG-Net holds significant potential for clinical applications in laparoscopic surgery. The code is available at: https://github.com/FDC-WuWeb/EG-Net .