Sensors

Research

Jump to: Review

14 pages, 1855 KiB

Open AccessArticle

A Bayesian Framework for Human Body Pose Tracking from Depth Image Sequences

by Youding Zhu and Kikuo Fujimura

Sensors 2010, 10(5), 5280-5293; https://doi.org/10.3390/s100505280 - 25 May 2010

Cited by 33 | Viewed by 12328

Abstract

This paper addresses the problem of accurate and robust tracking of 3D human body pose from depth image sequences. Recovering the large number of degrees of freedom in human body movements from a depth image sequence is challenging due to the need to [...] Read more.

This paper addresses the problem of accurate and robust tracking of 3D human body pose from depth image sequences. Recovering the large number of degrees of freedom in human body movements from a depth image sequence is challenging due to the need to resolve the depth ambiguity caused by self-occlusions and the difficulty to recover from tracking failure. Human body poses could be estimated through model fitting using dense correspondences between depth data and an articulated human model (local optimization method). Although it usually achieves a high accuracy due to dense correspondences, it may fail to recover from tracking failure. Alternately, human pose may be reconstructed by detecting and tracking human body anatomical landmarks (key-points) based on low-level depth image analysis. While this method (key-point based method) is robust and recovers from tracking failure, its pose estimation accuracy depends solely on image-based localization accuracy of key-points. To address these limitations, we present a flexible Bayesian framework for integrating pose estimation results obtained by methods based on key-points and local optimization. Experimental results are shown and performance comparison is presented to demonstrate the effectiveness of the proposed approach. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

21 pages, 607 KiB

Open AccessArticle

Non-Linearity Analysis of Depth and Angular Indexes for Optimal Stereo SLAM

by Luis M. Bergasa, Pablo F. Alcantarilla and David Schleicher

Sensors 2010, 10(4), 4159-4179; https://doi.org/10.3390/s100404159 - 26 Apr 2010

Cited by 4 | Viewed by 11593

Abstract

In this article, we present a real-time 6DoF egomotion estimation system for indoor environments using a wide-angle stereo camera as the only sensor. The stereo camera is carried in hand by a person walking at normal walking speeds 3–5 km/h. We present the [...] Read more.

In this article, we present a real-time 6DoF egomotion estimation system for indoor environments using a wide-angle stereo camera as the only sensor. The stereo camera is carried in hand by a person walking at normal walking speeds 3–5 km/h. We present the basis for a vision-based system that would assist the navigation of the visually impaired by either providing information about their current position and orientation or guiding them to their destination through different sensing modalities. Our sensor combines two different types of feature parametrization: inverse depth and 3D in order to provide orientation and depth information at the same time. Natural landmarks are extracted from the image and are stored as 3D or inverse depth points, depending on a depth threshold. This depth threshold is used for switching between both parametrizations and it is computed by means of a non-linearity analysis of the stereo sensor. Main steps of our system approach are presented as well as an analysis about the optimal way to calculate the depth threshold. At the moment each landmark is initialized, the normal of the patch surface is computed using the information of the stereo pair. In order to improve long-term tracking, a patch warping is done considering the normal vector information. Some experimental results under indoor environments and conclusions are presented. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

20 pages, 1002 KiB

Open AccessArticle

Optical Flow in a Smart Sensor Based on Hybrid Analog-Digital Architecture

by Pablo Guzmán, Javier Díaz, Rodrigo Agís and Eduardo Ros

Sensors 2010, 10(4), 2975-2994; https://doi.org/10.3390/s100402975 - 30 Mar 2010

Cited by 8 | Viewed by 13574

Abstract

The purpose of this study is to develop a motion sensor (delivering optical flow estimations) using a platform that includes the sensor itself, focal plane processing resources, and co-processing resources on a general purpose embedded processor. All this is implemented on a single [...] Read more.

The purpose of this study is to develop a motion sensor (delivering optical flow estimations) using a platform that includes the sensor itself, focal plane processing resources, and co-processing resources on a general purpose embedded processor. All this is implemented on a single device as a SoC (System-on-a-Chip). Optical flow is the 2-D projection into the camera plane of the 3-D motion information presented at the world scenario. This motion representation is widespread well-known and applied in the science community to solve a wide variety of problems. Most applications based on motion estimation require work in real-time; hence, this restriction must be taken into account. In this paper, we show an efficient approach to estimate the motion velocity vectors with an architecture based on a focal plane processor combined on-chip with a 32 bits NIOS II processor. Our approach relies on the simplification of the original optical flow model and its efficient implementation in a platform that combines an analog (focal-plane) and digital (NIOS II) processor. The system is fully functional and is organized in different stages where the early processing (focal plane) stage is mainly focus to pre-process the input image stream to reduce the computational cost in the post-processing (NIOS II) stage. We present the employed co-design techniques and analyze this novel architecture. We evaluate the system’s performance and accuracy with respect to the different proposed approaches described in the literature. We also discuss the advantages of the proposed approach as well as the degree of efficiency which can be obtained from the focal plane processing capabilities of the system. The final outcome is a low cost smart sensor for optical flow computation with real-time performance and reduced power consumption that can be used for very diverse application domains. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

Graphical abstract

21 pages, 1176 KiB

Open AccessArticle

Real-Time Estimation of Pathological Tremor Parameters from Gyroscope Data

by Juan A. Gallego, Eduardo Rocon, Javier O. Roa, Juan C. Moreno and José L. Pons

Sensors 2010, 10(3), 2129-2149; https://doi.org/10.3390/s100302129 - 16 Mar 2010

Cited by 96 | Viewed by 17919

Abstract

This paper presents a two stage algorithm for real-time estimation of instantaneous tremor parameters from gyroscope recordings. Gyroscopes possess the advantage of providing directly joint rotational speed, overcoming the limitations of traditional tremor recording based on accelerometers. The proposed algorithm first extracts tremor [...] Read more.

This paper presents a two stage algorithm for real-time estimation of instantaneous tremor parameters from gyroscope recordings. Gyroscopes possess the advantage of providing directly joint rotational speed, overcoming the limitations of traditional tremor recording based on accelerometers. The proposed algorithm first extracts tremor patterns from raw angular data, and afterwards estimates its instantaneous amplitude and frequency. Real-time separation of voluntary and tremorous motion relies on their different frequency contents, whereas tremor modelling is based on an adaptive LMS algorithm and a Kalman filter. Tremor parameters will be employed to drive a neuroprosthesis for tremor suppression based on biomechanical loading. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

Graphical abstract

21 pages, 2303 KiB

Open AccessArticle

A Multiscale Region-Based Motion Detection and Background Subtraction Algorithm

by Parisa Darvish Zadeh Varcheie, Michael Sills-Lavoie and Guillaume-Alexandre Bilodeau

Sensors 2010, 10(2), 1041-1061; https://doi.org/10.3390/s100201041 - 28 Jan 2010

Cited by 63 | Viewed by 14002

Abstract

This paper presents a region-based method for background subtraction. It relies on color histograms, texture information, and successive division of candidate rectangular image regions to model the background and detect motion. Our proposed algorithm uses this principle and combines it with Gaussian Mixture [...] Read more.

This paper presents a region-based method for background subtraction. It relies on color histograms, texture information, and successive division of candidate rectangular image regions to model the background and detect motion. Our proposed algorithm uses this principle and combines it with Gaussian Mixture background modeling to produce a new method which outperforms the classic Gaussian Mixture background subtraction method. Our method has the advantages of filtering noise during image differentiation and providing a selectable level of detail for the contour of the moving shapes. The algorithm is tested on various video sequences and is shown to outperform state-of-the-art background subtraction methods. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

22 pages, 1024 KiB

Open AccessArticle

Real-Time Accumulative Computation Motion Detectors

by Antonio Fernández-Caballero, María Teresa López, José Carlos Castillo and Saturnino Maldonado-Bascón

Sensors 2009, 9(12), 10044-10065; https://doi.org/10.3390/s91210044 - 10 Dec 2009

Cited by 12 | Viewed by 14381

Abstract

The neurally inspired accumulative computation (AC) method and its application to motion detection have been introduced in the past years. This paper revisits the fact that many researchers have explored the relationship between neural networks and finite state machines. Indeed, finite state machines [...] Read more.

The neurally inspired accumulative computation (AC) method and its application to motion detection have been introduced in the past years. This paper revisits the fact that many researchers have explored the relationship between neural networks and finite state machines. Indeed, finite state machines constitute the best characterized computational model, whereas artificial neural networks have become a very successful tool for modeling and problem solving. The article shows how to reach real-time performance after using a model described as a finite state machine. This paper introduces two steps towards that direction: (a) A simplification of the general AC method is performed by formally transforming it into a finite state machine. (b) A hardware implementation in FPGA of such a designed AC module, as well as an 8-AC motion detector, providing promising performance results. We also offer two case studies of the use of AC motion detectors in surveillance applications, namely infrared-based people segmentation and color-based people tracking, respectively. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

25 pages, 1301 KiB

Open AccessArticle

Segment Tracking via a Spatiotemporal Linking Process including Feedback Stabilization in an n-D Lattice Model

by Babette Dellen, Eren Erdal Aksoy and Florentin Wörgötter

Sensors 2009, 9(11), 9355-9379; https://doi.org/10.3390/s91109355 - 20 Nov 2009

Cited by 10 | Viewed by 13475

Abstract

Model-free tracking is important for solving tasks such as moving-object tracking and action recognition in cases where no prior object knowledge is available. For this purpose, we extend the concept of spatially synchronous dynamics in spin-lattice models to the spatiotemporal domain to track [...] Read more.

Model-free tracking is important for solving tasks such as moving-object tracking and action recognition in cases where no prior object knowledge is available. For this purpose, we extend the concept of spatially synchronous dynamics in spin-lattice models to the spatiotemporal domain to track segments within an image sequence. The method is related to synchronization processes in neural networks and based on superparamagnetic clustering of data. Spin interactions result in the formation of clusters of correlated spins, providing an automatic labeling of corresponding image regions. The algorithm obeys detailed balance. This is an important property as it allows for consistent spin-transfer across subsequent frames, which can be used for segment tracking. Therefore, in the tracking process the correct equilibrium will always be found, which is an important advance as compared with other more heuristic tracking procedures. In the case of long image sequences, i.e., movies, the algorithm is augmented with a feedback mechanism, further stabilizing segment tracking. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

Graphical abstract

14 pages, 288 KiB

Open AccessArticle

Measuring Gait Using a Ground Laser Range Sensor

by Tomàs Pallejà, Mercè Teixidó, Marcel Tresanchez and Jordi Palacín

Sensors 2009, 9(11), 9133-9146; https://doi.org/10.3390/s91109133 - 17 Nov 2009

Cited by 48 | Viewed by 14734

Abstract

This paper describes a measurement system designed to register the displacement of the legs using a two-dimensional laser range sensor with a scanning plane parallel to the ground and extract gait parameters. In the proposed methodology, the position of the legs is estimated [...] Read more.

This paper describes a measurement system designed to register the displacement of the legs using a two-dimensional laser range sensor with a scanning plane parallel to the ground and extract gait parameters. In the proposed methodology, the position of the legs is estimated by fitting two circles with the laser points that define their contour and the gait parameters are extracted applying a step-line model to the estimated displacement of the legs to reduce uncertainty in the determination of the stand and swing phase of the gait. Results obtained in a range up to 8 m shows that the systematic error in the location of one static leg is lower than 10 mm with and standard deviation lower than 8 mm; this deviation increases to 11 mm in the case of a moving leg. The proposed measurement system has been applied to estimate the gait parameters of six volunteers in a preliminary walking experiment. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

Graphical abstract

39 pages, 2075 KiB

Open AccessArticle

Classifying Human Leg Motions with Uniaxial Piezoelectric Gyroscopes

by Orkun Tunçel, Kerem Altun and Billur Barshan

Sensors 2009, 9(11), 8508-8546; https://doi.org/10.3390/s91108508 - 27 Oct 2009

Cited by 54 | Viewed by 15643

Abstract

This paper provides a comparative study on the different techniques of classifying human leg motions that are performed using two low-cost uniaxial piezoelectric gyroscopes worn on the leg. A number of feature sets, extracted from the raw inertial sensor data in different ways, [...] Read more.

This paper provides a comparative study on the different techniques of classifying human leg motions that are performed using two low-cost uniaxial piezoelectric gyroscopes worn on the leg. A number of feature sets, extracted from the raw inertial sensor data in different ways, are used in the classification process. The classification techniques implemented and compared in this study are: Bayesian decision making (BDM), a rule-based algorithm (RBA) or decision tree, least-squares method (LSM), k-nearest neighbor algorithm (k-NN), dynamic time warping (DTW), support vector machines (SVM), and artificial neural networks (ANN). A performance comparison of these classification techniques is provided in terms of their correct differentiation rates, confusion matrices, computational cost, and training and storage requirements. Three different cross-validation techniques are employed to validate the classifiers. The results indicate that BDM, in general, results in the highest correct classification rate with relatively small computational cost. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

Graphical abstract

14 pages, 4066 KiB

Open AccessArticle

REMOTE, a Wireless Sensor Network Based System to Monitor Rowing Performance

by Jordi Llosa, Ignasi Vilajosana, Xavier Vilajosana, Nacho Navarro, Emma Suriñach and Joan Manuel Marquès

Sensors 2009, 9(9), 7069-7082; https://doi.org/10.3390/s90907069 - 4 Sep 2009

Cited by 30 | Viewed by 12793

Abstract

In this paper, we take a hard look at the performance of REMOTE, a sensor network based application that provides a detailed picture of a boat movement, individual rower performance, or his/her performance compared with other crew members. The application analyzes data gathered [...] Read more.

In this paper, we take a hard look at the performance of REMOTE, a sensor network based application that provides a detailed picture of a boat movement, individual rower performance, or his/her performance compared with other crew members. The application analyzes data gathered with a WSN strategically deployed over a boat to obtain information on the boat and oar movements. Functionalities of REMOTE are compared to those of RowX [1] outdoor instrument, a commercial wired sensor instrument designed for similar purposes. This study demonstrates that with smart geometrical configuration of the sensors, rotation and translation of the oars and boat can be obtained. Three different tests are performed: laboratory calibration allows us to become familiar with the accelerometer readings and validate the theory, ergometer tests which help us to set the acquisition parameters, and on boat tests shows the application potential of this technologies in sports. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

25 pages, 838 KiB

Open AccessArticle

Adaptive Momentum-Based Motion Detection Approach and Its Application on Handoff in Wireless Networks

by Tein-Yaw Chung, Yung-Mu Chen and Chih-Hung Hsu

Sensors 2009, 9(7), 5715-5739; https://doi.org/10.3390/s90705715 - 17 Jul 2009

Cited by 10 | Viewed by 11509

Abstract

Positioning and tracking technologies can detect the location and the movement of mobile nodes (MNs), such as cellular phone, vehicular and mobile sensor, to predict potential handoffs. However, most motion detection mechanisms require additional hardware (e.g., GPS and directed antenna), costs (e.g., power [...] Read more.

Positioning and tracking technologies can detect the location and the movement of mobile nodes (MNs), such as cellular phone, vehicular and mobile sensor, to predict potential handoffs. However, most motion detection mechanisms require additional hardware (e.g., GPS and directed antenna), costs (e.g., power consumption and monetary cost) and supply systems (e.g., network fingerprint server). This paper proposes a Momentum of Received Signal Strength (MRSS) based motion detection method and its application on handoff. MRSS uses the exponentially weighted moving average filter with multiple moving average window size to analyze the received radio signal. With MRSS, an MN can predict its motion state and make a handoff trigger at the right time without any assistance from positioning systems. Moreover, a novel motion state dependent MRSS scheme called Dynamic MRSS (DMRSS) algorithm is proposed to adjust the motion detection sensitivity. In our simulation, the MRSSand DMRSS-based handoff algorithms can reduce the number of unnecessary handoffs up to 44% and save battery power up to 75%. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

Review

Jump to: Research

25 pages, 449 KiB

Open AccessReview

Visual Pathways Serving Motion Detection in the Mammalian Brain

by Alice Rokszin, Zita Márkus, Gábor Braunitzer, Antal Berényi, György Benedek and Attila Nagy

Sensors 2010, 10(4), 3218-3242; https://doi.org/10.3390/s100403218 - 1 Apr 2010

Cited by 27 | Viewed by 16694

Abstract

Motion perception is the process through which one gathers information on the dynamic visual world, in terms of the speed and movement direction of its elements. Motion sensation takes place from the retinal light sensitive elements, through the visual thalamus, the primary and [...] Read more.

Motion perception is the process through which one gathers information on the dynamic visual world, in terms of the speed and movement direction of its elements. Motion sensation takes place from the retinal light sensitive elements, through the visual thalamus, the primary and higher visual cortices. In the present review we aim to focus on the extrageniculo-extrastriate cortical and subcortical visual structures of the feline and macaque brain and discuss their functional role in visual motion perception. Special attention is paid to the ascending tectofugal system that may serve for detection of the visual environment during self-motion. Full article

(This article belongs to the Special Issue Motion Detectors)

► Show Figures

Journal Menu

Journal Browser

Motion Detectors

Share This Special Issue

Special Issue Editor

Keywords

Benefits of Publishing in a Special Issue

Published Papers (12 papers)

Research

Review

Further Information

Guidelines

MDPI Initiatives

Follow MDPI