Model-Based Real-Time Non-Rigid Tracking
AbstractThis paper presents a sequential non-rigid reconstruction method that recovers the 3D shape and the camera pose of a deforming object from a video sequence and a previous shape model of the object. We take PTAM (Parallel Mapping and Tracking), a state-of-the-art sequential real-time SfM (Structure-from-Motion) engine, and we upgrade it to solve non-rigid reconstruction. Our method provides a good trade-off between processing time and reconstruction error without the need for specific processing hardware, such as GPUs. We improve the original PTAM matching by using descriptor-based features, as well as smoothness priors to better constrain the 3D error. This paper works with perspective projection and deals with outliers and missing data. We evaluate the tracking algorithm performance through different tests over several datasets of non-rigid deforming objects. Our method achieves state-of-the-art accuracy and can be used as a real-time method suitable for being embedded in portable devices. View Full-Text
Share & Cite This Article
Bronte, S.; Bergasa, L.M.; Pizarro, D.; Barea, R. Model-Based Real-Time Non-Rigid Tracking. Sensors 2017, 17, 2342.
Bronte S, Bergasa LM, Pizarro D, Barea R. Model-Based Real-Time Non-Rigid Tracking. Sensors. 2017; 17(10):2342.Chicago/Turabian Style
Bronte, Sebastián; Bergasa, Luis M.; Pizarro, Daniel; Barea, Rafael. 2017. "Model-Based Real-Time Non-Rigid Tracking." Sensors 17, no. 10: 2342.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.