Ensemble Learning with Multi-Source Data Fusion for Modeling and Gap-Filling of Streetscape Greenery: An Application to Shichahai, Beijing
Highlights
- A multi-source data fusion framework was proposed for site-specific street-level Green View Index (GVI) gap-filling. The framework integrates street-view images, remote sensing imagery, road network data, building morphology, and land cover data to improve local spatial completeness in high-density historic urban areas.
- The Particle Swarm Optimization (PSO) Stacking ensemble model captures nonlinear relationships between environmental factors and GVI, supporting prediction of missing street-level greenery values.
- The framework provides a case-study workflow for reducing spatial blind spots in street-view-based greenery assessment and for linking satellite-derived greenness indicators with street-view-based GVI measurements, while its transferability requires independent validation in other districts.
- The gap-filled GVI map can help identify streets and blocks with insufficient visible greenery. It provides direct spatial evidence for targeted greening interventions, pedestrian environment improvement, and refined urban renewal in high-density historic urban areas.
Abstract
1. Introduction
- (1)
- First, it develops a workflow that combines semantic segmentation of street-view images with multi-source geospatial predictors to fill GVI gaps caused by insufficient street-view coverage.
- (2)
- Second, it evaluates the scale sensitivity of vegetation, spectral, road network, and building morphology variables at 25 m, 50 m, 75 m, and 100 m buffers, clarifying how environmental factors explain streetscape greenery at different spatial scales. It compares a PSO-optimized Stacking ensemble model with individual machine learning models and applies the best-performing local model to generate a continuous streetscape greenery map for the Shichahai case area.
- (3)
- Third, the framework leverages a diverse set of multi-source geospatial data, including street-view imagery, road networks, buildings, and remote sensing images. The fusion strategy involves three key stages: first, street-view images are processed via semantic segmentation to quantify the initial Green View Index (GVI). Subsequently, GVI geospatial predictors are constructed by fusing the structural attributes from road networks, buildings, and land cover data. Finally, a stacking ensemble learning model integrates these heterogeneous data sources—combining the visually derived GVI with the multi-source geospatial predictors—to accurately estimate and fill the spatial gaps in greenery coverage.
2. Materials and Methods
2.1. Study Area
2.2. Data Sources and Processing
- (1)
- Street-View Data
- (2)
- Remote Sensing Data
- (3)
- Building Data
- (4)
- Road Network Data
- (5)
- Land Cover Data
2.3. Research Methods
2.3.1. Gap-Filling of Streetscape Greenery Framework
- (1)
- Data layer. Street-view imagery, Sentinel-2 imagery, road networks, building morphology, land cover, and vegetation-related indicators are collected, cleaned, and harmonized within a common spatial reference. The detailed data sources and preprocessing procedures are described in Section 2.2.
- (2)
- Observation layer. DeepLabv3+ is used to identify vegetation pixels in available street-view images. Directional images collected at the same sampling point are averaged to obtain an observed GVI value, which serves as the response variable for model training and validation. The image segmentation and GVI calculation procedures are described in Section 2.3.2.
- (3)
- Feature and prediction layer. Environmental variables were extracted within buffer zones around the sampling points and used as explanatory variables in the ensemble learning model. This layer includes variable selection, multi-scale buffer construction, correlation screening, and the development of the PSO-optimized Stacking model, as detailed in Section 2.3.3.
- (4)
- Integration layer. For locations without valid street-view observations, GVI values were estimated using the trained model. These predicted values were then integrated with the observed GVI values to produce a continuous street-level GVI map. This process helps reduce spatial gaps in the mapped results while maintaining a clear distinction between directly observed values and model-based estimates. The integration and mapping procedures are described in Section 2.3.4.
2.3.2. Segmentation and Extraction of Street-Level GVI Based on Street-View Images
2.3.3. Ensemble Learning-Based Prediction of GVI
2.3.4. Spatial Gap-Filling and Continuous Mapping of Street-Level GVI
3. Results
3.1. Street-View GVI Extraction Results
3.2. Results of Environmental Feature Factors and Ensemble Learning-Based Spatial Prediction of GVI
3.3. Spatial Gap-Filling Results and Continuous Mapping of Street-Level GVI
4. Discussion
4.1. Street-Level GVI Extraction and Spatial Heterogeneity
4.2. Influence of Environmental Factors and Ensemble Learning Performance
4.3. Gap-Filling of Missing GVI and Continuous Spatial Mapping
4.4. Limitations and Uncertainty Propagation
5. Conclusions
- (1)
- The multi-source data fusion approach improved the spatial completeness of GVI representation within the Shichahai case area. GVI extraction based only on street-view images was constrained by incomplete image coverage, particularly in park interiors, enclosed spaces, narrow hutongs, and areas inaccessible to street-view collection vehicles. By incorporating remote sensing, building morphology, road network, and land cover features, the proposed approach provided a more continuous local representation of visible street greenery. This improvement should be interpreted as spatial gap-filling within the study area rather than as a general city-wide or cross-city prediction capability.
- (2)
- The PSO-Stacking ensemble learning model achieved the best local predictive performance among the tested models, including benchmark models, SVR, RF, and XGBoost, with an MAE of 0.0651 and an R2 of 0.81. These results suggest that, for the available Shichahai samples, the ensemble model was able to fit the nonlinear relationship between local environmental features and observed street-level GVI. However, the reported accuracy reflects internal validation under the data conditions of this specific study area and should not be interpreted as evidence of general predictive performance in other cities, seasons, or street-view image collection contexts.
- (3)
- The relationship between environmental factors and GVI showed scale sensitivity within the study area. Vegetation-related factors had stronger explanatory power at the 25 m micro-scale, suggesting that greenery close to the street is more directly associated with pedestrians’ visual exposure to vegetation. Building morphology factors, including building density, floor area ratio, and average building height, showed negative associations with GVI, especially at larger spatial scales. These results indicate that local visible greenery in Shichahai is shaped by both nearby vegetation supply and the spatial enclosure of the built environment.
- (4)
- The gap-filled GVI map revealed clear spatial heterogeneity in street-level visible greenery within Shichahai Subdistrict. Higher GVI values were mainly located along the Shichahai waterfront, around Beihai Park and Jingshan Park, and along roads with continuous street trees. Lower GVI values were mainly found in hutong blocks with narrow streets, high building density, and limited planting space. This spatial pattern indicates uneven visual exposure to greenery within the study area and highlights local areas where street-level greening may require further attention.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviations
| GVI | Green View Index |
| GSD | Green Space Density |
| BD | Building Density |
| ABH | Average Building Height |
| FAR | Floor Area Ratio |
| RND | Road Network Density |
References
- Hu, A.; Yabuki, N.; Fukuda, T.; Kaga, H.; Takeda, S.; Matsuo, K. Harnessing multiple data sources and emerging technologies for comprehensive urban green space evaluation. Cities 2023, 143, 104562. [Google Scholar] [CrossRef]
- Yu, S.; Yu, B.; Song, W.; Wu, B.; Zhou, J.; Huang, Y.; Wu, J.; Zhao, F.; Mao, W. View-based greenery: A three-dimensional assessment of city buildings’ green visibility using Floor Green View Index. Landsc. Urban Plan. 2016, 152, 13–26. [Google Scholar] [CrossRef]
- Duan, W.; Jin, A.; Liu, X.; Li, H. Seasonal variations and spatial mechanisms of 2D and 3D green indices in the central urban area. Ecol. Indic. 2025, 178, 113828. [Google Scholar] [CrossRef]
- Aoki, Y. Relationship between the Spread of Visual Field and the Feeling of Greenery. Landsc. Arch. 1987, 51, 1–10. [Google Scholar] [CrossRef]
- Zhang, W.; Zeng, H. Spatial differentiation characteristics and influencing factors of the green view index in urban areas based on street view images: A case study of Futian District, Shenzhen, China. Urban For. Urban Green. 2024, 93, 128219. [Google Scholar] [CrossRef]
- Yu, X.; Her, Y.; Huo, W.; Chen, G.; Qi, W. Spatio-temporal monitoring of urban street-side vegetation greenery using Baidu Street View images. Urban For. Urban Green. 2022, 73, 127617. [Google Scholar] [CrossRef]
- Wu, D.; Gong, J.; Liang, J.; Sun, J.; Zhang, G. Analyzing the influence of urban street greening and street buildings on summertime air pollution based on street view image data. ISPRS Int. J. Geo-Inf. 2020, 9, 500. [Google Scholar] [CrossRef]
- Gao, B.J.; Xiong, Q.L.; Chen, W.B.; He, H.Q.; Huang, Y.R.; Hong, Q.W.; Yang, K.K.; Zhao, X.M. Multi-Scale impacts of street view-based green viewindex on urban thermal environment within the thirdring road of nanchang. China Environ. Sci. 2025, 45, 6353–6365. [Google Scholar] [CrossRef]
- Rifas-Shiman, S.L.; Yi, L.; Aris, I.M.; Lin, P.-I.D.; Hivert, M.-F.; Chavarro, J.E.; Suel, E.; James, P.; Oken, E. Associations of street-view greenspace exposure with cardiovascular health (Life’s Essential 8) among women in midlife. Biol. Sex Differ. 2025, 16, 45. [Google Scholar] [CrossRef] [PubMed]
- Yi, L.; Hart, J.E.; Roscoe, C.; Mehta, U.V.; Jimenez, M.P.; Lin, P.-I.D.; Suel, E.; Hystad, P.; Hankey, S.; Zhang, W. Greenspace and depression incidence in the US-based nationwide Nurses’ Health Study II: A deep learning analysis of street-view imagery. Environ. Int. 2025, 198, 109429. [Google Scholar] [CrossRef] [PubMed]
- Wenpei, Z.; Linghong, K.; He, Z.; Zhiru, Z. Impacts of green space exposure and contact on residents′ mental health: A case study of Tianjin. Acta Ecol. Sin. 2025, 45, 3806–3818. [Google Scholar] [CrossRef]
- Huang, Z.; Tang, L.; Qiao, P.; He, J.; Su, H. Socioecological justice in urban street greenery based on green view index-A case study within the Fuzhou Third Ring Road. Urban For. Urban Green. 2024, 95, 128313. [Google Scholar] [CrossRef]
- Martin, A.J.F.; Conway, T.M. Using the Gini Index to quantify urban green inequality: A systematic review and recommended reporting standards. Landsc. Urban Plan. 2025, 254, 105231. [Google Scholar] [CrossRef]
- Aikoh, T.; Homma, R.; Abe, Y. Comparing conventional manual measurement of the green view index with modern automatic methods using google street view and semantic segmentation. Urban For. Urban Green. 2023, 80, 127845. [Google Scholar] [CrossRef]
- Tao, G.; Zhou, H.; Wang, Z.; Nie, Y.; Zhou, F. A Comparative Study on Different Identification Methods for Road Green Wiew Index——A Case Study of Xuzhou City. J. Northwest For. Univ. 2024, 39, 156–165. [Google Scholar]
- Li, F.; Zhou, X.; Wang, F.; Liu, L.; Tian, Z. Visual evaluation of road greening in Changsha based on big data of street view. J. Cent. South Univ. For. Technol. 2021, 41, 163–173. [Google Scholar] [CrossRef]
- Zhao, Z.; Tang, H.; Wei, D.; Qian, W. Spatial visibility of green areas of urban greenway using the green appearance percentage. J. Zhejiang AF Univ. 2016, 33, 288–294. [Google Scholar]
- Bishop, C.M. Neural networks and their applications. Rev. Sci. Instrum. 1994, 65, 1803–1832. [Google Scholar] [CrossRef]
- Chen, L.-C.; Zhu, Y.; Papandreou, G.; Schroff, F.; Adam, H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European Conference on Computer Vision (ECCV); Springer: Cham, Switzerland, 2018; pp. 801–818. [Google Scholar]
- Lu, Y.; Ferranti, E.J.S.; Chapman, L.; Pfrang, C. Assessing urban greenery by harvesting street view data: A review. Urban For. Urban Green. 2023, 83, 127917. [Google Scholar] [CrossRef]
- Li, T.; Zheng, X.; Wu, J.; Zhang, Y.; Fu, X.; Deng, H. Spatial relationship between green view index and normalized differential vegetation index within the Sixth Ring Road of Beijing. Urban For. Urban Green. 2021, 62, 127153. [Google Scholar] [CrossRef]
- Barbierato, E.; Bernetti, I.; Capecchi, I.; Saragosa, C. Integrating remote sensing and street view images to quantify urban forest ecosystem services. Remote Sens. 2020, 12, 329. [Google Scholar] [CrossRef]
- Geman, S.; Bienenstock, E.; Doursat, R. Neural networks and the bias/variance dilemma. Neural Comput. 1992, 4, 1–58. [Google Scholar] [CrossRef]
- Tang, J.; Long, Y. Measuring visual quality of street space and its temporal variation: Methodology and its application in the Hutong area in Beijing. Landsc. Urban Plan. 2019, 191, 103436. [Google Scholar] [CrossRef]
- Cura, R.; Perret, J.; Paparoditis, N. A state of the art of urban reconstruction: Street, street network, vegetation, urban feature. arXiv 2018, arXiv:1803.04332. [Google Scholar]
- Baidu Maps. Available online: https://lbsyun.baidu.com/ (accessed on 25 August 2025).
- Mooney, P.; Minghini, M. A review of OpenStreetMap data. In Mapping and the Citizen Sensor; Ubiquity Press: London, UK, 2017. [Google Scholar]
- Zhang, Y.; Zhao, H.; Long, Y. CMAB: A multi-attribute building dataset of China. Sci. Data 2025, 12, 430. [Google Scholar] [CrossRef] [PubMed]
- Li, Z.; He, W.; Cheng, M.; Hu, J.; Yang, G.; Zhang, H. SinoLC-1: The first 1 m resolution national-scale land-cover map of China created with a deep learning framework and open-access data. Earth Syst. Sci. Data 2023, 15, 4749–4780. [Google Scholar] [CrossRef]
- Cordts, M.; Omran, M.; Ramos, S.; Rehfeld, T.; Enzweiler, M.; Benenson, R.; Franke, U.; Roth, S.; Schiele, B. The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016; pp. 3213–3223. [Google Scholar]
- Tong, M.; She, J.; Tan, J.; Li, M.; Ge, R.; Gao, Y. Evaluating Street Greenery by Multiple Indicators Using Street-Level Imagery and Satellite Images: A Case Study in Nanjing, China. Forests 2020, 11, 1347. [Google Scholar] [CrossRef]
- Sun, S.; Huss, A.; Probst-Hensch, N.; Vienneau, D.; de Hoogh, K. Comparison of machine learning algorithms for green view index (GVI) prediction using NDVI and urban form metrics. Urban For. Urban Green. 2026, 120, 129412. [Google Scholar] [CrossRef]
- Wang, L. Support Vector Machines: Theory and Applications; Springer Science & Business Media: Berlin, Germany; London, UK, 2005; Volume 177. [Google Scholar]
- Breiman, L. Random forests. Mach. Learn. 2001, 45, 5–32. [Google Scholar] [CrossRef]
- Chen, T.; Guestrin, C. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 13–17 August 2016; pp. 785–794. [Google Scholar]
- Oke, T.R. Canyon geometry and the nocturnal urban heat island: Comparison of scale model and field observations. J. Climatol. 1981, 1, 237–254. [Google Scholar] [CrossRef]
- Karimimoshaver, M.; Khalvandi, R.; Khalvandi, M. The effect of urban morphology on heat accumulation in urban street canyons and mitigation approach. Sustain. Cities Soc. 2021, 73, 103127. [Google Scholar] [CrossRef]
- Li, G.; Ren, Z.; Zhan, C. Sky View Factor-based correlation of landscape morphology and the thermal environment of street canyons: A case study of Harbin, China. Build. Environ. 2020, 169, 106587. [Google Scholar] [CrossRef]
- Li, X.; Zhang, C.; Li, W.; Ricard, R.; Meng, Q.; Zhang, W. Assessing street-level urban greenery using Google Street View and a modified green view index. Urban For. Urban Green. 2015, 14, 675–685. [Google Scholar] [CrossRef]
- Kumakoshi, Y.; Chan, S.Y.; Koizumi, H.; Li, X.; Yoshimura, Y. Standardized Green View Index and Quantification of Different Metrics of Urban Green Vegetation. Sustainability 2020, 12, 7434. [Google Scholar] [CrossRef]
- Gou, A.; Wang, X.; Wang, J.; Wang, C.; Tan, G. Spatial pattern and heterogeneity of green view index in mountainous cities: A case study of Yuzhong district, Chongqing, China. Sci. Rep. 2025, 15, 12576. [Google Scholar] [CrossRef] [PubMed]








| Feature Factor | Calculation Formula | Formula Meaning | Data Source |
|---|---|---|---|
| Road Network Density (RND) | Road network density within the buffer centered at sampling point with radius . Where: is the road network density; is the total road length within the buffer (m); is the buffer area (). | OSM | |
| Building Density (BD) | Building density within the buffer centered at sampling point with radius . Where: is the building density; denotes the set of buildings within the buffer; is the footprint area of building (); is the buffer area (). | CMAB: A Multi-Attribute Building Dataset of China | |
| Average Building Height (ABH) | Average building height within the buffer centered at sampling point with radius . Where: is the average building height; denotes the set of buildings within the buffer; is the height of building (m); is the number of buildings within the buffer. | ||
| Floor Area Ratio (FAR) | Floor area ratio within the buffer centered at sampling point with radius . Where: is the floor area ratio; denotes the set of buildings within the buffer; is the footprint area of building (); is the number of floors of building ; is the buffer area (). | ||
| Green Space Density (GSD) | Green space density within the buffer centered at sampling point with radius . Where: is the green space density; is the area of green space patch (); is the buffer area (). | https://zenodo.org/records/8214467 (accessed on 20 July 2025) | |
| NDVI | NDVI within the buffer centered at sampling point with radius . Where: is the mean NDVI; is the NDVI value of pixel ; is the total number of pixels within the buffer. | https://earthengine.google.com/ (accessed on 25 August 2025) | |
| Mean Spectral Band (B2, B3, B4, B8) | Mean reflectance of spectral band within the buffer centered at sampling point with radius . Where: is the mean reflectance of band ; is the pixel value of band for pixel ; is the total number of pixels within the buffer. | ||
| Fractional Vegetation Cover (FVC) | Fractional vegetation cover within the buffer centered at sampling point with radius . Where: is the fractional vegetation cover; is the mean NDVI within the buffer; is the NDVI value of bare soil; is the NDVI value of fully vegetated surfaces. |
| Feature Factor | 25 m | 50 m | 75 m | 100 m |
|---|---|---|---|---|
| GSD | 0.64 | 0.51 | 0.48 | 0.46 |
| NDVI | 0.71 | 0.66 | 0.51 | 0.48 |
| BD | −0.23 | −0.25 | −0.26 | −0.26 |
| ABH | −0.08 | −0.10 | −0.11 | −0.12 |
| FAR | −0.22 | −0.25 | −0.27 | −0.27 |
| RND | 0.02 | 0.04 | 0.04 | 0.03 |
| B2 | −0.52 | −0.50 | −0.46 | −0.43 |
| B3 | −0.49 | −0.48 | −0.44 | −0.42 |
| B4 | −0.53 | −0.51 | −0.46 | −0.43 |
| B8 | 0.38 | 0.22 | 0.11 | 0.04 |
| FVC | 0.61 | 0.54 | 0.48 | 0.43 |
| Feature Factor | 25 m | 50 m | 75 m | 100 m |
|---|---|---|---|---|
| GSD | 0.50 | 0.47 | 0.47 | 0.45 |
| NDVI | 0.64 | 0.59 | 0.53 | 0.49 |
| BD | −0.30 | −0.27 | −0.27 | −0.26 |
| ABH | −0.17 | −0.13 | −0.11 | −0.11 |
| FAR | −0.30 | −0.28 | −0.27 | −0.27 |
| RND | 0.05 | 0.08 | 0.07 | 0.05 |
| B2 | −0.55 | −0.50 | −0.45 | −0.41 |
| B3 | −0.53 | −0.48 | −0.43 | −0.40 |
| B4 | −0.57 | −0.50 | −0.45 | −0.41 |
| B8 | 0.40 | 0.23 | 0.15 | 0.10 |
| FVC | 0.64 | 0.58 | 0.51 | 0.45 |
| Feature Factor | 25 m | 50 m | 75 m | 100 m |
|---|---|---|---|---|
| GSD | 0.06 | 0.08 | 0.09 | 0.09 |
| NDVI | 0.37 | 0.33 | 0.28 | 0.26 |
| BD | 0.05 | 0.05 | 0.06 | 0.07 |
| ABH | 0.07 | 0.07 | 0.08 | 0.09 |
| FAR | 0.05 | 0.05 | 0.06 | 0.07 |
| RND | 0.09 | 0.10 | 0.09 | 0.11 |
| B2 | 0.06 | 0.06 | 0.07 | 0.08 |
| B3 | 0.04 | 0.05 | 0.04 | 0.04 |
| B4 | 0.04 | 0.06 | 0.06 | 0.06 |
| B8 | 0.06 | 0.06 | 0.07 | 0.06 |
| FVC | 0.10 | 0.09 | 0.09 | 0.06 |
| Model | Training MAE | Training R2 | Validation MAE | Validation R2 |
|---|---|---|---|---|
| NDVI-only | 0.0948 | 0.45 | 0.0976 | 0.42 |
| LR | 0.0875 | 0.56 | 0.0913 | 0.52 |
| Ridge Regression | 0.0881 | 0.55 | 0.0905 | 0.53 |
| Lasso Regression | 0.0902 | 0.52 | 0.0931 | 0.50 |
| KNN | 0.0647 | 0.79 | 0.0802 | 0.68 |
| SVR | 0.0745 | 0.68 | 0.0833 | 0.63 |
| RF | 0.0416 | 0.91 | 0.0736 | 0.75 |
| XGBoost | 0.0453 | 0.89 | 0.0844 | 0.64 |
| Stacking | 0.0389 | 0.93 | 0.0651 | 0.81 |
| Model | Random Validation R2 | Spatial CV R2 | Random Validation MAE | Spatial CV MAE |
|---|---|---|---|---|
| SVR | 0.63 | 0.56 | 0.0833 | 0.0875 |
| RF | 0.75 | 0.64 | 0.0736 | 0.0803 |
| XGBoost | 0.64 | 0.57 | 0.0844 | 0.0825 |
| Stacking | 0.81 | 0.70 | 0.0651 | 0.0713 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Hu, L.; Ma, J.; Liu, H.; Zhang, L. Ensemble Learning with Multi-Source Data Fusion for Modeling and Gap-Filling of Streetscape Greenery: An Application to Shichahai, Beijing. Remote Sens. 2026, 18, 2459. https://doi.org/10.3390/rs18152459
Hu L, Ma J, Liu H, Zhang L. Ensemble Learning with Multi-Source Data Fusion for Modeling and Gap-Filling of Streetscape Greenery: An Application to Shichahai, Beijing. Remote Sensing. 2026; 18(15):2459. https://doi.org/10.3390/rs18152459
Chicago/Turabian StyleHu, Lujin, Jianing Ma, Hao Liu, and Lixuan Zhang. 2026. "Ensemble Learning with Multi-Source Data Fusion for Modeling and Gap-Filling of Streetscape Greenery: An Application to Shichahai, Beijing" Remote Sensing 18, no. 15: 2459. https://doi.org/10.3390/rs18152459
APA StyleHu, L., Ma, J., Liu, H., & Zhang, L. (2026). Ensemble Learning with Multi-Source Data Fusion for Modeling and Gap-Filling of Streetscape Greenery: An Application to Shichahai, Beijing. Remote Sensing, 18(15), 2459. https://doi.org/10.3390/rs18152459
