Sensors 2013, 13(3), 3409-3431; doi:10.3390/s130303409

Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast

Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an 710049, China
* Authors to whom correspondence should be addressed.
Received: 1 January 2013; in revised form: 19 February 2013 / Accepted: 7 March 2013 / Published: 12 March 2013
(This article belongs to the Section Physical Sensors)
PDF Full-text Download PDF Full-Text [7782 KB, uploaded 12 March 2013 11:34 CET]
Abstract: Salient object perception is the process of sensing the salient information from the spatio-temporal visual scenes, which is a rapid pre-attention mechanism for the target location in a visual smart sensor. In recent decades, many successful models of visual saliency perception have been proposed to simulate the pre-attention behavior. Since most of the methods usually need some ad hoc parameters or high-cost preprocessing, they are difficult to rapidly detect salient object or be implemented by computing parallelism in a smart sensor. In this paper, we propose a novel spatio-temporal saliency perception method based on spatio-temporal hypercomplex spectral contrast (HSC). Firstly, the proposed HSC algorithm represent the features in the HSV (hue, saturation and value) color space and features of motion by a hypercomplex number. Secondly, the spatio-temporal salient objects are efficiently detected by hypercomplex Fourier spectral contrast in parallel. Finally, our saliency perception model also incorporates with the non-uniform sampling, which is a common phenomenon of human vision that directs visual attention to the logarithmic center of the image/video in natural scenes. The experimental results on the public saliency perception datasets demonstrate the effectiveness of the proposed approach compared to eleven state-of-the-art approaches. In addition, we extend the proposed model to moving object extraction in dynamic scenes, and the proposed algorithm is superior to the traditional algorithms.
Keywords: spatio-temporal; salient object; hypercomplex; visual attention; visual perception; spectral contrast

Article Statistics

Load and display the download statistics.

Citations to this Article

Cite This Article

MDPI and ACS Style

Li, C.; Xue, J.; Zheng, N.; Lan, X.; Tian, Z. Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast. Sensors 2013, 13, 3409-3431.

AMA Style

Li C, Xue J, Zheng N, Lan X, Tian Z. Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast. Sensors. 2013; 13(3):3409-3431.

Chicago/Turabian Style

Li, Ce; Xue, Jianru; Zheng, Nanning; Lan, Xuguang; Tian, Zhiqiang. 2013. "Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast." Sensors 13, no. 3: 3409-3431.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert