Hierarchical sketch encoding and text-guided 3D modeling: a novel approach for single free-hand sketch reconstruction
摘要
Sketch-based 3D reconstruction aims to generate 3D models from sparse and abstract hand-drawn sketches, a task challenging due to missing depth cues and ambiguous 2D observations. We propose a hierarchical sketch encoding and text-guided 3D modeling approach, employing a deep sketch fuse encoder to capture hierarchical sketch features and a multi-modal viewpoint supervision strategy for richer guidance. Our method achieves state-of-the-art performance on both synthetic and real datasets, demonstrating its potential to simplify 3D modeling for novice users. The source code and models will be publicly available at https://github.com/QinchuanLei/HETG-3D-Modeling.