<p>Current 3D Gaussian Splatting (GS) reconstruction methods in endoscopy struggle with high similarity among endoscopy images and large dynamic changes caused by intestinal peristalsis. To address these limitations, we introduce the Dual-Domain Deformation Model (<InlineEquation ID="IEq4"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="371_2025_4062_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {D}^{3}\hbox {M}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msup> <mtext>D</mtext> <mn>3</mn> </msup> <mtext>M</mtext> </mrow> </math></EquationSource> </InlineEquation>), a novel approach that accurately models the intestinal lining with dynamic and complex deformations. <InlineEquation ID="IEq5"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="371_2025_4062_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {D}^{3}\hbox {M}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msup> <mtext>D</mtext> <mn>3</mn> </msup> <mtext>M</mtext> </mrow> </math></EquationSource> </InlineEquation> innovates by operating in both spatial and temporal domains, enabling robust tracking and reconstruction of the intestinal surface despite significant motion and appearance changes. Unlike existing methods, <InlineEquation ID="IEq6"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="371_2025_4062_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {D}^{3}\hbox {M}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msup> <mtext>D</mtext> <mn>3</mn> </msup> <mtext>M</mtext> </mrow> </math></EquationSource> </InlineEquation> employs a unique dual-domain framework that enhances its ability to capture intricate deformations and maintain reconstruction accuracy. Through extensive experiments on the EndoNeRF and StereoMIS dataset, we demonstrate that <InlineEquation ID="IEq7"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="371_2025_4062_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {D}^{3}\hbox {M}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msup> <mtext>D</mtext> <mn>3</mn> </msup> <mtext>M</mtext> </mrow> </math></EquationSource> </InlineEquation> significantly outperforms existing 3D-GS techniques, achieving higher reconstruction accuracy and robustness. Quantitative metrics reveal substantial improvements in error rates and computational efficiency, validating our claim of superior performance. These results highlight <InlineEquation ID="IEq8"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="371_2025_4062_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {D}^{3}\hbox {M}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msup> <mtext>D</mtext> <mn>3</mn> </msup> <mtext>M</mtext> </mrow> </math></EquationSource> </InlineEquation>’s effectiveness in capturing the complex dynamics of the intestinal lining, offering a more accurate and reliable 3D reconstruction. This advancement has the potential to revolutionize endoscopic imaging by providing detailed and dynamic visualizations of the intestinal environment, thereby enhancing clinical utility. Future work will focus on clinical validation to assess the practical impact of <InlineEquation ID="IEq9"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="371_2025_4062_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {D}^{3}\hbox {M}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msup> <mtext>D</mtext> <mn>3</mn> </msup> <mtext>M</mtext> </mrow> </math></EquationSource> </InlineEquation> in real-world endoscopic procedures. Additionally, we will explore the scalability and adaptability of <InlineEquation ID="IEq10"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="371_2025_4062_Article_IEq2.gif" Format="GIF" Height="17" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(\hbox {D}^{3}\hbox {M}\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <msup> <mtext>D</mtext> <mn>3</mn> </msup> <mtext>M</mtext> </mrow> </math></EquationSource> </InlineEquation> to handle different types of endoscopic procedures and other medical imaging modalities, ensuring its broad applicability in diverse clinical settings.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

\(\hbox {D}^3\)M-GS: Dynamic endoscopy reconstruction via dual-domain deformation model

  • Jinyang Wang,
  • Xuequan Lu,
  • Haoxuan Li,
  • Xiaojun Huang,
  • Jun Xia

摘要

Current 3D Gaussian Splatting (GS) reconstruction methods in endoscopy struggle with high similarity among endoscopy images and large dynamic changes caused by intestinal peristalsis. To address these limitations, we introduce the Dual-Domain Deformation Model ( \(\hbox {D}^{3}\hbox {M}\) D 3 M ), a novel approach that accurately models the intestinal lining with dynamic and complex deformations. \(\hbox {D}^{3}\hbox {M}\) D 3 M innovates by operating in both spatial and temporal domains, enabling robust tracking and reconstruction of the intestinal surface despite significant motion and appearance changes. Unlike existing methods, \(\hbox {D}^{3}\hbox {M}\) D 3 M employs a unique dual-domain framework that enhances its ability to capture intricate deformations and maintain reconstruction accuracy. Through extensive experiments on the EndoNeRF and StereoMIS dataset, we demonstrate that \(\hbox {D}^{3}\hbox {M}\) D 3 M significantly outperforms existing 3D-GS techniques, achieving higher reconstruction accuracy and robustness. Quantitative metrics reveal substantial improvements in error rates and computational efficiency, validating our claim of superior performance. These results highlight \(\hbox {D}^{3}\hbox {M}\) D 3 M ’s effectiveness in capturing the complex dynamics of the intestinal lining, offering a more accurate and reliable 3D reconstruction. This advancement has the potential to revolutionize endoscopic imaging by providing detailed and dynamic visualizations of the intestinal environment, thereby enhancing clinical utility. Future work will focus on clinical validation to assess the practical impact of \(\hbox {D}^{3}\hbox {M}\) D 3 M in real-world endoscopic procedures. Additionally, we will explore the scalability and adaptability of \(\hbox {D}^{3}\hbox {M}\) D 3 M to handle different types of endoscopic procedures and other medical imaging modalities, ensuring its broad applicability in diverse clinical settings.