<p>Digital technology promotes the way of art protection, exhibition and redesign to be constantly updated. However, the traditional three-dimensional reconstruction method still has insufficient performance in complex texture, detail reduction and structural continuity. In this study, a 3D model reconstruction and design optimization evaluation system based on multi-modal neural network is proposed to meet the digital needs of artworks. The main scientific contribution of this study is to transform artwork 3D reconstruction from a single reconstruction-oriented task into an integrated framework that combines multimodal feature fusion, image-based semantic recognition, reconstruction quality assessment, and design-oriented optimization. With RGB, depth, normal, infrared and semantic data as inputs, a 3D expression framework with stable structure and fine texture is constructed. Study and construct a multi-dimensional index system, including geometric accuracy, texture quality, structural integrity, visual performance and redesign, and design an interpretable comprehensive evaluation mechanism to realize quantitative analysis of reconstruction quality. In the experiment, 500 sets of three-dimensional samples were used for geometric accuracy testing, and 30 sets of artwork models were used for system evaluation and verification. The results show that the multi-modal fusion significantly improves the geometric error control ability, and the average error of Method C is 0.25 mm, with the most concentrated error distribution and good structural continuity. Feature space clustering forms stable clusters, which proves that the model can effectively distinguish different materials and texture complexity. The design optimization evaluation system has achieved high scores in all five indicators, which shows that the model has the characteristics of repeatable editing, robust texture restoration and strong structural repair ability. Research and form an extensible reconstruction and evaluation method to provide technical support for digital preservation, virtual display and redesign of works of art.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Construction of 3D model reconstruction and design optimization evaluation system of artworks based on multimodal neural network and image recognition

  • Fang Fang

摘要

Digital technology promotes the way of art protection, exhibition and redesign to be constantly updated. However, the traditional three-dimensional reconstruction method still has insufficient performance in complex texture, detail reduction and structural continuity. In this study, a 3D model reconstruction and design optimization evaluation system based on multi-modal neural network is proposed to meet the digital needs of artworks. The main scientific contribution of this study is to transform artwork 3D reconstruction from a single reconstruction-oriented task into an integrated framework that combines multimodal feature fusion, image-based semantic recognition, reconstruction quality assessment, and design-oriented optimization. With RGB, depth, normal, infrared and semantic data as inputs, a 3D expression framework with stable structure and fine texture is constructed. Study and construct a multi-dimensional index system, including geometric accuracy, texture quality, structural integrity, visual performance and redesign, and design an interpretable comprehensive evaluation mechanism to realize quantitative analysis of reconstruction quality. In the experiment, 500 sets of three-dimensional samples were used for geometric accuracy testing, and 30 sets of artwork models were used for system evaluation and verification. The results show that the multi-modal fusion significantly improves the geometric error control ability, and the average error of Method C is 0.25 mm, with the most concentrated error distribution and good structural continuity. Feature space clustering forms stable clusters, which proves that the model can effectively distinguish different materials and texture complexity. The design optimization evaluation system has achieved high scores in all five indicators, which shows that the model has the characteristics of repeatable editing, robust texture restoration and strong structural repair ability. Research and form an extensible reconstruction and evaluation method to provide technical support for digital preservation, virtual display and redesign of works of art.