Next Article in Journal
Sparse Bayes Tensor and DOA Tracking Inspired Channel Estimation for V2X Millimeter Wave Massive MIMO System
Previous Article in Journal
High-Efficiency Super-Resolution FMCW Radar Algorithm Based on FFT Estimation
Article

Region-Based Static Video Stitching for Reduction of Parallax Distortion

1
The Information Technology & Mobile Communications Biz., Samsung Electronics, Suwon-si 16677, Gyeonggi-do, Korea
2
School of Electronics and Information Engineering, Korea Aerospace University, Goyang-si 10540, Gyeonggi-do, Korea
3
Deptartment of Smart Drone Convergence, Korea Aerospace University, Goyang-si 10540, Gyeonggi-do, Korea
*
Author to whom correspondence should be addressed.
Academic Editor: Jenny Benois-Pineau
Sensors 2021, 21(12), 4020; https://doi.org/10.3390/s21124020
Received: 25 February 2021 / Revised: 4 June 2021 / Accepted: 8 June 2021 / Published: 10 June 2021
(This article belongs to the Section Sensing and Imaging)
In this paper, we propose a semantic segmentation-based static video stitching method to reduce parallax and misalignment distortion for sports stadium scenes with dynamic foreground objects. First, video frame pairs for stitching are divided into segments of different classes through semantic segmentation. Region-based stitching is performed on matched segment pairs, assuming that segments of the same semantic class are on the same plane. Second, to prevent degradation of the stitching quality of plain or noisy videos, the homography for each matched segment pair is estimated using the temporally consistent feature points. Finally, the stitched video frame is synthesized by stacking the stitched matched segment pairs and the foreground segments to the reference frame plane by descending order of the area. The performance of the proposed method is evaluated by comparing the subjective quality, geometric distortion, and pixel distortion of video sequences stitched using the proposed and conventional methods. The proposed method is shown to reduce parallax and misalignment distortion in segments with plain texture or large parallax, and significantly improve geometric distortion and pixel distortion compared to conventional methods. View Full-Text
Keywords: video stitching; homography estimation; semantic segmentation; region-based video stitching video stitching; homography estimation; semantic segmentation; region-based video stitching
Show Figures

Figure 1

MDPI and ACS Style

Park, K.-w.; Shim, Y.-J.; Lee, M.-j. Region-Based Static Video Stitching for Reduction of Parallax Distortion. Sensors 2021, 21, 4020. https://doi.org/10.3390/s21124020

AMA Style

Park K-w, Shim Y-J, Lee M-j. Region-Based Static Video Stitching for Reduction of Parallax Distortion. Sensors. 2021; 21(12):4020. https://doi.org/10.3390/s21124020

Chicago/Turabian Style

Park, Keon-woo; Shim, Yoo-Jeong; Lee, Myeong-jin. 2021. "Region-Based Static Video Stitching for Reduction of Parallax Distortion" Sensors 21, no. 12: 4020. https://doi.org/10.3390/s21124020

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop