Deep Learning-Based Type Recognition and Spatial Analysis of Overseas Chinese Yanglou Dwellings in Jinjiang, China
Abstract
1. Introduction
1.1. Research Background
1.2. Literature Review
1.2.1. Limitations and Challenges in the Study of Overseas Chinese Yanglou Dwellings
1.2.2. Applications of Deep Learning Models in Architectural Classification and Feature Extraction
2. Materials and Methods
2.1. Study Area and Research Objects
2.2. Data Sources and Preprocessing
- Geometric correction: A small number of obviously tilted images were corrected to restore the vertical and horizontal relationships of the facade and reduce the influence of viewpoint deviation on morphological interpretation.
- Image enhancement: Images with local blur, insufficient contrast, or uneven brightness were moderately adjusted to improve the visibility of key architectural features, such as building outlines, doors and windows, pediments, and galleries.
- Input normalization: Images were resized to a unified input scale and normalized to meet the input requirements of the deep learning models, ensuring consistency across the training data.
2.3. Methods
2.3.1. Research Workflow
- In the unsupervised exploration stage, the official Ultralytics pretrained YOLO11n-cls classification model was used as the feature extractor to obtain deep visual representations from Yanglou facade images. These features were then combined with K-means clustering and low-dimensional visualization methods to explore potential morphological transitional relationships among the samples.
- Based on the unsupervised results and expert architectural interpretation, a facade classification framework was established, and the cleaned facade image dataset was organized according to the A1–C3 classification system for subsequent supervised model training.
- YOLOv8n-cls, YOLO11n-cls, and YOLO26n-cls were trained and evaluated using category-wise five-fold cross-validation. Model performance was assessed using accuracy, precision, recall, F1-score, and confusion matrices.
- Feature map visualization, Grad-CAM heatmaps, t-SNE, and related visualization methods were used to analyze the key facade regions attended to by the model and the basis for model decisions. The recognition results were further integrated with GIS to examine the spatial distribution characteristics of different Yanglou types.
2.3.2. Model Selection
2.3.3. K-Means-Based Unsupervised Clustering
2.3.4. Training Strategy and Parameter Configuration
2.3.5. Evaluation Metrics
2.3.6. Interpretability Analysis Methods
3. Results
3.1. Unsupervised Clustering Analysis Based on K-Means
3.2. Type Subdivision Based on Clustering Results
3.3. Classification Results of Overseas Chinese Yanglou Dwellings
3.4. Interpretability Analysis
3.4.1. Feature Layer Visualization Results
3.4.2. t-SNE Visualization Results
3.4.3. Grad-CAM Visualization Results
3.5. GIS Spatial Analysis
4. Discussion
4.1. From Typological Knowledge to Image Feature Recognition
4.2. Potential Application in Digital Heritage Documentation and Conservation Management
4.3. Limitations and Future Prospects
5. Conclusions
- The unsupervised analysis revealed exploratory morphological differentiation patterns among the Yanglou samples, supplementing expert-based typological understanding from the perspective of image features. Based on the degree of retention of local traditional elements and the intensity of Westernized features, the samples can be summarized into three morphological tendencies: “Traditional Continuity Type”, “Partial Addition Type”, and “Overall Transformation Type”.
- Under category-wise five-fold cross-validation, YOLO11n-cls achieved the highest overall validation performance among the tested models within the current Jinjiang sample set. Comparative experiments with YOLOv8n-cls and YOLO26n-cls indicate that YOLO11n-cls is relatively more suitable for the facade classification of Jinjiang Yanglou dwellings in this study. Grad-CAM heatmaps show that the main regions attended to by the model are generally consistent with typical architectural elements of Yanglou summarized in previous studies, suggesting that the model can capture facade features with architectural typological significance to some extent.
- GIS-based spatial analysis shows that the surveyed Jinjiang samples exhibit a pronounced inland–coastal differentiation, but this differentiation does not form a continuous or homogeneous gradient of diffusion. This result suggests that, within the current Jinjiang case, Western architectural culture did not spread in Jinjiang through a simple one-way process from the coast to the inland area, nor is there a direct positive correlation between coastal proximity and the degree of Westernization. Rather, Yanglou facade forms can be understood as the result of cultural adaptation shaped by the local vernacular dwelling framework, remittance-based house construction, and craftsmen’s building practices. Highly Westernized types are clustered only in limited localities, whereas hybrid and localized forms became widely adopted. The influence of overseas Chinese family wealth, social status, and building intentions on facade-type selection still requires further empirical investigation based on genealogies, qiaopi correspondence, family documents, and field interviews.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Letellier, R.; Eppich, R. Recording, Documentation and Information Management for the Conservation of Heritage Places; Getty Conservation Institute: Los Angeles, CA, USA, 2015. [Google Scholar]
- Xu, Z.R. Kinmen Yanglou Architecture; Daotian Publishing Co., Ltd.: Taipei, China, 1999. (In Chinese) [Google Scholar]
- Xie, H.Q. A Preliminary Study on Modern Yanglou Dwellings in Quanzhou. Master’s Thesis, Huaqiao University, Quanzhou, China, 1999. (In Chinese) [Google Scholar]
- Chen, Z.H. Research on Modern Regional Architecture in Southern Fujian Qiaoxiang. Doctoral Dissertation, Tianjin University, Tianjin, China, 2005. (In Chinese) [Google Scholar]
- Chen, Z.H.; Zeng, J. A Comparative Study on Modern Regional Architectural Culture in Southern Fujian Qiaoxiang. Architect 2007, 125, 72–76. (In Chinese) [Google Scholar]
- Jiang, B.W. “Five-Foot-Way” Yanglou: Cultural Hybridity and Modern Imagination in Modern Southern Fujian Qiaoxiang Society. Archit. J. 2012, 10, 92–96. (In Chinese) [Google Scholar]
- Guo, H.Y. A Comparative Study on the Culture of Modern Overseas Chinese Dwellings in Guangdong Qiaoxiang. Doctoral Dissertation, South China University of Technology, Guangzhou, China, 2015. (In Chinese) [Google Scholar]
- Li, Y.C. A Comparative Study on Architectural Culture of Modern Qiaoxiang in Southern Fujian and Chaoshan. Doctoral Dissertation, South China University of Technology, Guangzhou, China, 2015. (In Chinese) [Google Scholar]
- Tian, Y. A Preliminary Study on the Research Status of Overseas Chinese Architecture in Singapore and Malaysia. Master’s Thesis, Huaqiao University, Quanzhou, China, 2018. (In Chinese) [Google Scholar]
- Guan, X.X.; Chen, Z.H.; Tu, X.Q. Transoceanic Dissemination and Cross-Border Conservation: A Study on the Conservation and Restoration Model of Overseas Chinese Architectural Heritage in Penang, Malaysia. New Archit. 2024, 213, 59–64. (In Chinese) [Google Scholar]
- Ramalingam, S.P.; Kumar, V. Automatizing the generation of building usage maps from geotagged street view images using deep learning. Build. Environ. 2023, 235, 110215. [Google Scholar] [CrossRef] [Scilit]
- Zou, H.; Ge, J.; Liu, R.; He, L. Feature Recognition of Regional Architecture Forms Based on Machine Learning: A Case Study of Architecture Heritage in Hubei Province, China. Sustainability 2023, 15, 3504. [Google Scholar] [CrossRef] [Scilit]
- Han, Q.; Yin, C.; Deng, Y.; Liu, P. Towards Classification of Architectural Styles of Chinese Traditional Settlements Using Deep Learning: A Dataset, a New Framework, and Its Interpretability. Remote Sens. 2022, 14, 5250. [Google Scholar] [CrossRef] [Scilit]
- Wu, J.; Ying, Y.; Tan, Y.; Liu, Z. Innovative Framework for Historical Architectural Recognition in China: Integrating Swin Transformer and Global Channel–Spatial Attention Mechanism. Buildings 2025, 15, 176. [Google Scholar] [CrossRef] [Scilit]
- Miao, S.; Zhang, C.; Piao, Y.; Miao, Y. Classification and Model Explanation of Traditional Dwellings Based on Improved Swin Transformer. Buildings 2024, 14, 1540. [Google Scholar] [CrossRef] [Scilit]
- Zhang, Y.; Wang, B.; Li, J. Kangba Region of Sichuan based on swin transformer visual model research on the identification of facades of ethnic buildings. Sci. Rep. 2024, 14, 28742. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zu, X.; Gao, C.; Wang, Y. Interpreting regional characteristics of Tibetan-Qiang houses in Northwestern Sichuan by Deep Learning and Image Landscape. Int. J. Appl. Earth Obs. Geoinf. 2024, 129, 103865. [Google Scholar] [CrossRef] [Scilit]
- Bao, S.-H.; Zhuo, X.-L.; Tao, J. Using semi-supervised machine learning to assist classification and recognition of Chinese vernacular architecture. J. Build. Eng. 2024, 98, 111327. [Google Scholar] [CrossRef] [Scilit]
- Ji, S.-Y.; Jun, H.-J. Deep Learning Model for Form Recognition and Structural Member Classification of East Asian Traditional Buildings. Sustainability 2020, 12, 5292. [Google Scholar] [CrossRef] [Scilit]
- Gonzalez, D.; Rueda-Plata, D.; Acevedo, A.B.; Duque, J.C.; Ramos-Pollán, R.; Betancourt, A.; García, S. Automatic detection of building typology using deep learning methods on street level images. Build. Environ. 2020, 177, 106805. [Google Scholar] [CrossRef] [Scilit]
- Zhao, J.; Han, C.; Wu, Y.; Xu, C.; Huang, X.; Qi, X.; Qi, Y.; Gao, L. A deep learning-based study on visual quality assessment of commercial renovation of Chinese traditional building facades. Environ. Impact Assess. Rev. 2025, 113, 107862. [Google Scholar] [CrossRef] [Scilit]
- Li, Y.; Zhao, M.; Mao, J.; Chen, Y.; Zheng, L.; Yan, L. Detection and recognition of Chinese porcelain inlay images of traditional Lingnan architectural decoration based on YOLOv4 technology. Herit. Sci. 2024, 12, 137. [Google Scholar] [CrossRef] [Scilit]
- Qin, W.; Chen, L.; Zhang, B.; Chen, W.; Luo, H. NeoDescriber: An image-to-text model for automatic style description of neoclassical architecture. Expert Syst. Appl. 2023, 231, 120706. [Google Scholar] [CrossRef] [Scilit]
- Sun, M.; Zhang, F.; Duarte, F.; Ratti, C. Understanding architecture age and style through deep learning. Cities 2022, 128, 103787. [Google Scholar] [CrossRef] [Scilit]
- Wang, S.; Zhang, J.; Tun, A.N.; Sein, K. Research on Identification, Evaluation, and Digitization of Historical Buildings Based on Deep Learning Algorithms: A Case Study of Quanzhou World Cultural Heritage Site. Buildings 2025, 15, 1843. [Google Scholar] [CrossRef] [Scilit]
- Siountri, K.; Anagnostopoulos, C.-N. The Classification of Cultural Heritage Buildings in Athens Using Deep Learning Techniques. Heritage 2023, 6, 3673–3705. [Google Scholar] [CrossRef] [Scilit]
- Zhang, L.Z. The Stylistic Evolution of Traditional Houses in Qingyang Town, Jinjiang City and Its Historical Causes. J. Chin. Archit. Hist. 2012, 2, 477–488. (In Chinese) [Google Scholar]
- Ultralytics. Model Export with Ultralytics YOLO. Available online: https://docs.ultralytics.com/modes/export/ (accessed on 8 July 2026).
- Ultralytics. Explore Ultralytics YOLOv8. Available online: https://docs.ultralytics.com/models/yolov8/ (accessed on 8 July 2026).
- Ultralytics. Ultralytics YOLO11. Available online: https://docs.ultralytics.com/models/yolo11/ (accessed on 8 July 2026).
- Jocher, G.; Qiu, J.; Liu, M.; Lyu, S.; Akyon, F.C.; Kalfaoglu, M.E. Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models. arXiv 2026, arXiv:2606.03748. [Google Scholar] [CrossRef] [Scilit]
- Han, S.; Lee, J. Parallelized Inter-Image k-Means Clustering Algorithm for Unsupervised Classification of Series of Satellite Images. Remote Sens. 2024, 16, 102. [Google Scholar] [CrossRef] [Scilit]
- Aly, G.H.; Marey, M.; El-Sayed, S.A.; Tolba, M.F. YOLO Based Breast Masses Detection and Classification in Full-Field Digital Mammograms. Comput. Methods Programs Biomed. 2021, 200, 105823. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Wang, X. The analysis of sculpture image classification in utilization of 3D reconstruction under K-means++. Sci. Rep. 2025, 15, 18127. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- van der Maaten, L.; Hinton, G. Visualizing Data using t-SNE. J. Mach. Learn. Res. 2008, 9, 2579–2605. [Google Scholar]
- Zeiler, M.D.; Fergus, R. Visualizing and Understanding Convolutional Networks. In Computer Vision—ECCV 2014, Proceedings of the 13th European Conference on Computer Vision, Zurich, Switzerland, 6–12 September 2014; Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T., Eds.; Springer: Cham, Switzerland, 2014; Volume 8689, pp. 818–833. [Google Scholar] [CrossRef] [Scilit]
- Selvaraju, R.R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh, D.; Batra, D. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Int. J. Comput. Vis. 2020, 128, 336–359. [Google Scholar] [CrossRef] [Scilit]
- Wang, C.; Gao, M.; Xu, Z.; Li, Z. Semantic Ontology Study of Facade Form of Modern Veranda-Fronted Buildings in Wuhu City. Archit. J. 2015, S1, 101–107. (In Chinese) [Google Scholar]
- Wu, T. Jinjiang Overseas Chinese Chronicle; Shanghai People’s Publishing House: Shanghai, China, 1994. (In Chinese) [Google Scholar]
- Zhang, J.; Pang, J. Spatial Analysis of Minnan Residential Architecture from the Perspective of Migration Culture; Southeast University Press: Nanjing, China, 2019. (In Chinese) [Google Scholar]
- Liu, Y.S. Types and Distribution of Veranda-Style Buildings in Modern China. South Archit. 2011, 2, 36–42. (In Chinese) [Google Scholar]














| Item | Setting |
|---|---|
| K-means robustness test | random_state = 0, 1, 7, 21, 42, 100, 2024 |
| UMAP visualization | n_neighbors = 15; min_dist = 0.1; n_components = 2; random_state = 42 |
| Parameter | Setting |
|---|---|
| imgsz | 640 |
| Epochs | 100 |
| Batch size | 8 |
| Optimizer | AdamW |
| Initial learning rate | 0.001 |
| Weight decay | 0.0005 |
| Loss function | Cross-entropy loss |
| HSV-H | 0.015 |
| HSV-S | 0.7 |
| HSV-V | 0.4 |
| Translate | 0.1 |
| Scale | 0.5 |
| Horizontal flip | 0.5 |
| Auto augment | RandAugment |
| Random erasing | 0.4 |
| CPU | 13th Gen Intel Core i7-13620H (Intel Corporation, Santa Clara, CA, USA) |
| GPU | NVIDIA GeForce RTX 4060 (Intel Corporation, Santa Clara, CA, USA) |
| RAM | 16.0 GB |
| Cluster | Samples Near the Cluster Center | Type Tendency | |||
|---|---|---|---|---|---|
| Cluster 0 | ![]() | ![]() | ![]() | ![]() | Traditional Dacuo-base Type |
| Cluster 1 | ![]() | ![]() | ![]() | ![]() | Sino-Western Hybrid Type |
| Cluster 2 | ![]() | ![]() | ![]() | ![]() | More Westernized Type |
| Category | Diagram | Photograph | Characteristics | |||
|---|---|---|---|---|---|---|
| (Type A) Traditional Continuity | (A1) Fanzai Cuo | ![]() | ![]() | ![]() | ![]() | Non-storeyed dwelling with Westernized entrance and facade decoration. |
![]() | ![]() | ![]() | ![]() | |||
![]() | ![]() | ![]() | ![]() | |||
| (A2) Detached Yanglou—Taxiu Type | ![]() | ![]() | ![]() | ![]() | Vertically transformed Dacuo with a recessed gallery. | |
| (Type B) Partial Addition | (B1) Partially Westernized Traditional Dacuo | ![]() | ![]() | ![]() | ![]() | Local vertical transformation within a traditional Dacuo courtyard dwelling. In formal terms, it embodies the transplantation and integration of foreign architectural forms within the inherent spatial order of traditional dwellings. |
![]() | ![]() | ![]() | ![]() | |||
![]() | ![]() | ![]() | ![]() | |||
![]() | ![]() | ![]() | ![]() | |||
![]() | ![]() | ![]() | ![]() | |||
| (B2) Detached Yanglou—Five-Foot Way Type | ![]() | ![]() | ![]() | ![]() | Flush gallery attached to the main facade of a vertically transformed Dacuo. | |
| (Type C) Overall Transformation | (C1) Detached Yanglou—Chugui Type | ![]() | ![]() | ![]() | ![]() | Central projecting gallery forming a convex facade. |
| (C2) Detached Yanglou—Double-Chugui Type | ![]() | ![]() | ![]() | ![]() | Bilateral projecting galleries or volumes. | |
| (C3) Detached Yanglou—Composite Type | ![]() | ![]() | ![]() | ![]() | Combined gallery forms across the facade. | |
| Category | Facade Images | Training Samples per Fold | Validation Samples per Fold |
|---|---|---|---|
| A1 | 36 | 28–29 | 7–8 |
| A2 | 107 | 85–86 | 21–22 |
| B1 | 35 | 28 | 7 |
| B2 | 151 | 120–121 | 30–31 |
| C1 | 42 | 33–34 | 8–9 |
| C2 | 34 | 27–28 | 6–7 |
| C3 | 30 | 24 | 6 |
| Total | 435 | 345–350 | 85–89 |
| Model | Accuracy | Precision | Recall | F1-Score |
|---|---|---|---|---|
| YOLOv8n-cls | 0.7718 ± 0.0371 | 0.7706 ± 0.0442 | 0.7718 ± 0.0371 | 0.7618 ± 0.0391 |
| YOLO11n-cls | 0.8089 ± 0.0439 | 0.8155 ± 0.0449 | 0.8089 ± 0.0439 | 0.7945 ± 0.0479 |
| YOLO26n-cls | 0.7879 ± 0.0438 | 0.7931 ± 0.0451 | 0.7879 ± 0.0438 | 0.7825 ± 0.0428 |
| Model | Layers | Parameters/M | Model Size/MB | GFLOPs | Inference Time/ms Image−1 |
|---|---|---|---|---|---|
| YOLOv8n-cls | 56 | 1.45 | 2.84 | 3.4 | 77.07 ± 3.91 |
| YOLO11n-cls | 86 | 1.54 | 3.06 | 3.3 | 80.21 ± 6.82 |
| YOLO26n-cls | 86 | 1.54 | 3.06 | 3.3 | 80.40 ± 5.30 |
| Model | Category | Precision | Recall | F1-Score | Support |
|---|---|---|---|---|---|
| YOLOv8 | A1 | 0.6765 | 0.6389 | 0.6571 | 36 |
| A2 | 0.7953 | 0.9439 | 0.8632 | 107 | |
| B1 | 0.7857 | 0.6286 | 0.6984 | 35 | |
| B2 | 0.8581 | 0.8808 | 0.8693 | 151 | |
| C1 | 0.6774 | 0.5 | 0.5753 | 42 | |
| C2 | 0.6 | 0.5294 | 0.5625 | 34 | |
| C3 | 0.6 | 0.6 | 0.6 | 30 | |
| YOLO11 | A1 | 0.75 | 0.6667 | 0.7059 | 36 |
| A2 | 0.8387 | 0.972 | 0.9004 | 107 | |
| B1 | 0.8065 | 0.7143 | 0.7576 | 35 | |
| B2 | 0.8509 | 0.9073 | 0.8782 | 151 | |
| C1 | 0.8333 | 0.4762 | 0.6061 | 42 | |
| C2 | 0.6923 | 0.5294 | 0.6 | 34 | |
| C3 | 0.6486 | 0.8 | 0.7164 | 30 | |
| YOLO26 | A1 | 0.7647 | 0.7222 | 0.7429 | 36 |
| A2 | 0.8462 | 0.9252 | 0.8839 | 107 | |
| B1 | 0.8519 | 0.6571 | 0.7419 | 35 | |
| B2 | 0.8645 | 0.8874 | 0.8758 | 151 | |
| C1 | 0.6098 | 0.5952 | 0.6024 | 42 | |
| C2 | 0.5676 | 0.6176 | 0.5915 | 34 | |
| C3 | 0.625 | 0.5 | 0.5556 | 30 |
| Item | Setting |
|---|---|
| Perplexity | 30 |
| Learning rate | auto |
| Number of iterations | 1000 |
| Initialization | PCA |
| Random seed | 42 |
| Category | Grad-CAM Heatmap Activation Regions | |||||||
|---|---|---|---|---|---|---|---|---|
| (A1) Fanzai Cuo | Facade Composition | Wall Surface | Beam–Column Structure | Pediment | ||||
![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | |
| (A2) Detached Yanglou—Taxiu Type | Facade Composition | Wall Surface | Gallery | Balustrade | ||||
![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | |
| (B1) Partially Westernized Traditional Dacuo | Facade Composition | Vertically Transformed Part | Dacuo Wall Surface | Gallery | Balustrade | |||
![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | |
| (B2) Detached Yanglou—Five-Foot Way Type | Facade Composition | Beam–Column Structure | Arch Form | Balustrade | ||||
![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | |
| (C1) Detached Yanglou—Chugui Type | Facade Composition | Chugui entrance porch | Balustrades and Mouldings | |||||
![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | |
| (C2) Detached Yanglou—Double-Chugui Type | Facade Composition | Gallery | Corner Tower | Pediment | ||||
![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | |
| (C3) Detached Yanglou—Composite Type | Facade Composition | Gallery | Entrance Porch | |||||
![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | ![]() | |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Lai, S.; Ke, Y.; Liu, X. Deep Learning-Based Type Recognition and Spatial Analysis of Overseas Chinese Yanglou Dwellings in Jinjiang, China. Buildings 2026, 16, 2880. https://doi.org/10.3390/buildings16142880
Lai S, Ke Y, Liu X. Deep Learning-Based Type Recognition and Spatial Analysis of Overseas Chinese Yanglou Dwellings in Jinjiang, China. Buildings. 2026; 16(14):2880. https://doi.org/10.3390/buildings16142880
Chicago/Turabian StyleLai, Shixian, Yetong Ke, and Xin Liu. 2026. "Deep Learning-Based Type Recognition and Spatial Analysis of Overseas Chinese Yanglou Dwellings in Jinjiang, China" Buildings 16, no. 14: 2880. https://doi.org/10.3390/buildings16142880
APA StyleLai, S., Ke, Y., & Liu, X. (2026). Deep Learning-Based Type Recognition and Spatial Analysis of Overseas Chinese Yanglou Dwellings in Jinjiang, China. Buildings, 16(14), 2880. https://doi.org/10.3390/buildings16142880
























































































































