Open AccessThis article is
- freely available
Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast
Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an 710049, China
* Authors to whom correspondence should be addressed.
Received: 1 January 2013; in revised form: 19 February 2013 / Accepted: 7 March 2013 / Published: 12 March 2013
Abstract: Salient object perception is the process of sensing the salient information from the spatio-temporal visual scenes, which is a rapid pre-attention mechanism for the target location in a visual smart sensor. In recent decades, many successful models of visual saliency perception have been proposed to simulate the pre-attention behavior. Since most of the methods usually need some ad hoc parameters or high-cost preprocessing, they are difficult to rapidly detect salient object or be implemented by computing parallelism in a smart sensor. In this paper, we propose a novel spatio-temporal saliency perception method based on spatio-temporal hypercomplex spectral contrast (HSC). Firstly, the proposed HSC algorithm represent the features in the HSV (hue, saturation and value) color space and features of motion by a hypercomplex number. Secondly, the spatio-temporal salient objects are efficiently detected by hypercomplex Fourier spectral contrast in parallel. Finally, our saliency perception model also incorporates with the non-uniform sampling, which is a common phenomenon of human vision that directs visual attention to the logarithmic center of the image/video in natural scenes. The experimental results on the public saliency perception datasets demonstrate the effectiveness of the proposed approach compared to eleven state-of-the-art approaches. In addition, we extend the proposed model to moving object extraction in dynamic scenes, and the proposed algorithm is superior to the traditional algorithms.
Keywords: spatio-temporal; salient object; hypercomplex; visual attention; visual perception; spectral contrast
Citations to this Article
Cite This Article
MDPI and ACS Style
Li, C.; Xue, J.; Zheng, N.; Lan, X.; Tian, Z. Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast. Sensors 2013, 13, 3409-3431.
Li C, Xue J, Zheng N, Lan X, Tian Z. Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast. Sensors. 2013; 13(3):3409-3431.
Li, Ce; Xue, Jianru; Zheng, Nanning; Lan, Xuguang; Tian, Zhiqiang. 2013. "Spatio-Temporal Saliency Perception via Hypercomplex Frequency Spectral Contrast." Sensors 13, no. 3: 3409-3431.