Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion
AbstractHeavy occlusions in cluttered scenes impose significant challenges to many computer vision applications. Recent light field imaging systems provide new see-through capabilities through synthetic aperture imaging (SAI) to overcome the occlusion problem. Existing synthetic aperture imaging methods, however, emulate focusing at a specific depth layer, but are incapable of producing an all-in-focus see-through image. Alternative in-painting algorithms can generate visually-plausible results, but cannot guarantee the correctness of the results. In this paper, we present a novel depth-free all-in-focus SAI technique based on light field visibility analysis. Specifically, we partition the scene into multiple visibility layers to directly deal with layer-wise occlusion and apply an optimization framework to propagate the visibility information between multiple layers. On each layer, visibility and optimal focus depth estimation is formulated as a multiple-label energy minimization problem. The layer-wise energy integrates all of the visibility masks from its previous layers, multi-view intensity consistency and depth smoothness constraint together. We compare our method with state-of-the-art solutions, and extensive experimental results demonstrate the effectiveness and superiority of our approach. View Full-Text
Share & Cite This Article
Yang, T.; Li, J.; Yu, J.; Zhang, Y.; Ma, W.; Tong, X.; Yu, R.; Ran, L. Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion. Sensors 2015, 15, 18965-18984.
Yang T, Li J, Yu J, Zhang Y, Ma W, Tong X, Yu R, Ran L. Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion. Sensors. 2015; 15(8):18965-18984.Chicago/Turabian Style
Yang, Tao; Li, Jing; Yu, Jingyi; Zhang, Yanning; Ma, Wenguang; Tong, Xiaomin; Yu, Rui; Ran, Lingyan. 2015. "Multiple-Layer Visibility Propagation-Based Synthetic Aperture Imaging through Occlusion." Sensors 15, no. 8: 18965-18984.