Next Article in Journal
Sliding Time Master Digital Image Correlation Analyses of CubeSat Images for landslide Monitoring: The Rattlesnake Hills Landslide (USA)
Previous Article in Journal
Identification of Active Gully Erosion Sites in the Loess Plateau of China Using MF-DFA
Previous Article in Special Issue
Geometric Accuracy Improvement Method for High-Resolution Optical Satellite Remote Sensing Imagery Combining Multi-Temporal SAR Imagery and GLAS Data
Open AccessLetter

A Unified Framework for Depth Prediction from a Single Image and Binocular Stereo Matching

College of Computer, National University of Defense Technology, Changsha 410073, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2020, 12(3), 588; https://doi.org/10.3390/rs12030588
Received: 24 December 2019 / Revised: 5 February 2020 / Accepted: 6 February 2020 / Published: 10 February 2020
Depth information has long been an important issue in computer vision. The methods for this can be categorized into (1) depth prediction from a single image and (2) binocular stereo matching. However, these two methods are generally regarded as separate tasks, which are accomplished in different network architectures when using deep learning-based methods. This study argues that these two tasks can be achieved using only one network with the same weights. We modify existing networks for stereo matching to perform the two tasks. We first enable the network capable of accepting both a single image and an image pair by duplicating the left image when the right image is absent. Then, we introduce a training procedure that alternatively selects training samples of depth prediction from a single image and binocular stereo matching. In this manner, the trained network can perform both tasks and single-image depth prediction even benefits from stereo matching to achieve better performance. Experimental results on KITTI raw dataset show that our model achieves state-of-the-art performances for accomplishing depth prediction from a single image and binocular stereo matching in the same architecture. View Full-Text
Keywords: depth prediction; binocular stereo matching; network architecture depth prediction; binocular stereo matching; network architecture
Show Figures

Graphical abstract

MDPI and ACS Style

Chen, W.; Luo, X.; Liang, Z.; Li, C.; Wu, M.; Gao, Y.; Jia, X. A Unified Framework for Depth Prediction from a Single Image and Binocular Stereo Matching. Remote Sens. 2020, 12, 588.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop