Identifying and interpreting traditional architectural style characteristics based on deep learning
摘要
The interpretation of traditional architectural styles usually relies solely on the architecture itself, lacking a collaborative interpretation of multi-level features. In this paper, a hierarchical framework is proposed using multi-source data. First, the natural environment is analyzed through terrain, water, and vegetation using a digital elevation model and remote sensing images. Secondly, architectural features are analyzed by using the proposed dual-branch network model and Grad-CAM method with remote sensing images and online architectural landscape images. Thirdly, architectural landscapes are extracted by using semantic segmentation model and T-SNE method with online architectural landscape images. The hierarchical framework systematically reveals the inherent coupling relationship among natural environment, architectural features, and architectural landscapes from multiple levels. Based on traditional architecture dataset, the proposed dual-branch model achieves the highest average value of recall (89.73%), precision (90.37%), and F1-score (89.60%). The framework can provide technical support for the protection of Chinese traditional architectural cultural heritage.