<p>Sketch-based 3D reconstruction aims to generate 3D models from sparse and abstract hand-drawn sketches, a task challenging due to missing depth cues and ambiguous 2D observations. We propose a hierarchical sketch encoding and text-guided 3D modeling approach, employing a deep sketch fuse encoder to capture hierarchical sketch features and a multi-modal viewpoint supervision strategy for richer guidance. Our method achieves state-of-the-art performance on both synthetic and real datasets, demonstrating its potential to simplify 3D modeling for novice users. The source code and models will be publicly available at <a href="https://github.com/QinchuanLei/HETG-3D-Modeling">https://github.com/QinchuanLei/HETG-3D-Modeling</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Hierarchical sketch encoding and text-guided 3D modeling: a novel approach for single free-hand sketch reconstruction

  • Qinchuan Lei,
  • Nannan Li,
  • Jiaming Zhong,
  • Min Zhao,
  • Mengbao Fan

摘要

Sketch-based 3D reconstruction aims to generate 3D models from sparse and abstract hand-drawn sketches, a task challenging due to missing depth cues and ambiguous 2D observations. We propose a hierarchical sketch encoding and text-guided 3D modeling approach, employing a deep sketch fuse encoder to capture hierarchical sketch features and a multi-modal viewpoint supervision strategy for richer guidance. Our method achieves state-of-the-art performance on both synthetic and real datasets, demonstrating its potential to simplify 3D modeling for novice users. The source code and models will be publicly available at https://github.com/QinchuanLei/HETG-3D-Modeling.