Next Article in Journal
Indoor Topological Localization Using a Visual Landmark Sequence
Previous Article in Journal
Group Line Energy in Phase-Resolved Ocean Surface Wave Orbital Velocity Reconstructions from X-band Doppler Radar Measurements of the Sea Surface
Article Menu
Issue 1 (January-1) cover image

Export Article

Open AccessArticle
Remote Sens. 2019, 11(1), 72; https://doi.org/10.3390/rs11010072

Automatic Shadow Detection in Urban Very-High-Resolution Images Using Existing 3D Models for Free Training

1
Department of Geoscience and Remote Sensing, Delft University of Technology, 2628 CN Delft, The Netherlands
2
Faculty of Built Environment, University of New South Wales, Sydney, NSW 2033, Australia
*
Author to whom correspondence should be addressed.
Received: 2 December 2018 / Revised: 25 December 2018 / Accepted: 28 December 2018 / Published: 3 January 2019
(This article belongs to the Section Urban Remote Sensing)
Full-Text   |   PDF [8786 KB, uploaded 9 January 2019]   |  

Abstract

Up-to-date 3D city models are needed for many applications. Very-high-resolution (VHR) images with rich geometric and spectral information and a high update rate are increasingly applied for the purpose of updating 3D models. Shadow detection is the primary step for image interpretation, as shadow causes radiometric distortions. In addition, shadow itself is valuable geometric information. However, shadows are often complicated and environment-dependent. Supervised learning is considered to perform well in detecting shadows when training samples selected from these images are available. Unfortunately, manual labeling of images is expensive. Existing 3D models have been used to reconstruct shadows to provide free, computer-generated training samples, i.e., samples free from intensive manual labeling. However, accurate shadow reconstruction for large 3D models consisting of millions of triangles is either difficult or time-consuming. In addition, due to inaccuracy and incompleteness of the model, and different acquisition time between 3D models and images, mislabeling refers to training samples that are shadows but labeled as non-shadows and vice versa. We propose a ray-tracing approach with an effective KD tree construction to feasibly reconstruct accurate shadows for a large 3D model. An adaptive erosion approach is first provided to remove mislabeling effects near shadow boundaries. Next, a comparative study considering four classification methods, quadratic discriminant analysis (QDA) fusion, support vector machine (SVM), K nearest neighbors (KNN) and Random forest (RF), is performed to select the best classification method with respect to capturing the complicated properties of shadows and robustness to mislabeling. The experiments are performed on Dutch Amersfoort data with around 20% mislabels and the Toronto benchmark by simulating mislabels from inverting shadows to non-shadows. RF is tested to give robust and best results with 95.38% overall accuracy (OA) and a value of 0.9 for kappa coefficient (KC) for Amersfoort and around 96% OA and 0.92 KC for Toronto benchmarks when no more than 50% of shadows are inverted. QDA fusion and KNN are tested to be robust to mislabels but their capability to capture complicated properties of shadows is worse than RF. SVM is tested to have a good capability to separate shadow and non-shadows but is largely affected by mislabeled samples. It is shown that RF with free-training samples from existing 3D models is an automatic, effective, and robust approach for shadow detection from VHR images. View Full-Text
Keywords: shadow detection; 3D city model; free training; ray tracing; KD tree; erosion; mislabels; random forest; robust shadow detection; 3D city model; free training; ray tracing; KD tree; erosion; mislabels; random forest; robust
Figures

Graphical abstract

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Zhou, K.; Lindenbergh, R.; Gorte, B. Automatic Shadow Detection in Urban Very-High-Resolution Images Using Existing 3D Models for Free Training. Remote Sens. 2019, 11, 72.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Remote Sens. EISSN 2072-4292 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top