Sensors 2013, 13(3), 3409-3431; doi:10.3390/s130303409

Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast

* email, * email, email, email and email
Received: 1 January 2013; in revised form: 19 February 2013 / Accepted: 7 March 2013 / Published: 12 March 2013
(This article belongs to the Section Physical Sensors)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: Salient object perception is the process of sensing the salient information from the spatio-temporal visual scenes, which is a rapid pre-attention mechanism for the target location in a visual smart sensor. In recent decades, many successful models of visual saliency perception have been proposed to simulate the pre-attention behavior. Since most of the methods usually need some ad hoc parameters or high-cost preprocessing, they are difficult to rapidly detect salient object or be implemented by computing parallelism in a smart sensor. In this paper, we propose a novel spatio-temporal saliency perception method based on spatio-temporal hypercomplex spectral contrast (HSC). Firstly, the proposed HSC algorithm represent the features in the HSV (hue, saturation and value) color space and features of motion by a hypercomplex number. Secondly, the spatio-temporal salient objects are efficiently detected by hypercomplex Fourier spectral contrast in parallel. Finally, our saliency perception model also incorporates with the non-uniform sampling, which is a common phenomenon of human vision that directs visual attention to the logarithmic center of the image/video in natural scenes. The experimental results on the public saliency perception datasets demonstrate the effectiveness of the proposed approach compared to eleven state-of-the-art approaches. In addition, we extend the proposed model to moving object extraction in dynamic scenes, and the proposed algorithm is superior to the traditional algorithms.
Keywords: spatio-temporal; salient object; hypercomplex; visual attention; visual perception; spectral contrast
PDF Full-text Download PDF Full-Text [7782 KB, uploaded 21 June 2014 06:34 CEST]

Export to BibTeX |

MDPI and ACS Style

Li, C.; Xue, J.; Zheng, N.; Lan, X.; Tian, Z. Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast. Sensors 2013, 13, 3409-3431.

AMA Style

Li C, Xue J, Zheng N, Lan X, Tian Z. Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast. Sensors. 2013; 13(3):3409-3431.

Chicago/Turabian Style

Li, Ce; Xue, Jianru; Zheng, Nanning; Lan, Xuguang; Tian, Zhiqiang. 2013. "Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast." Sensors 13, no. 3: 3409-3431.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert