Sensors 2014, 14(2), 2259-2279; doi:10.3390/s140202259

3D Joint Speaker Position and Orientation Tracking with Particle Filters

1,* email and 2email
Received: 24 December 2013; in revised form: 17 January 2014 / Accepted: 25 January 2014 / Published: 29 January 2014
(This article belongs to the Special Issue Last Trends in Acoustic Sensing)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: This paper addresses the problem of three-dimensional speaker orientation estimation in a smart-room environment equipped with microphone arrays. A Bayesian approach is proposed to jointly track the location and orientation of an active speaker. The main motivation is that the knowledge of the speaker orientation may yield an increased localization performance and vice versa. Assuming that the sound produced by the speaker is originated from his mouth, the center of the head is deduced based on the estimated head orientation. Moreover, the elevation angle of the head of the speaker can be partly inferred from the fast vertical movements of the computed mouth location. In order to test the performance of the proposed algorithm, a new multimodal dataset has been recorded for this purpose, where the corresponding 3D orientation angles are acquired by an inertial measurement unit (IMU) provided by accelerometers, magnetometers and gyroscopes in the three-axes. The proposed joint algorithm outperforms a two-step approach in terms of localization and orientation angle precision assessing the superiority of the joint approach.
Keywords: head pose; speaker orientation; acoustic source localization
PDF Full-text Download PDF Full-Text [833 KB, Updated Version, uploaded 21 June 2014 11:54 CEST]
The original version is still available [838 KB, uploaded 21 June 2014 11:54 CEST]

Export to BibTeX |

MDPI and ACS Style

Segura, C.; Hernando, J. 3D Joint Speaker Position and Orientation Tracking with Particle Filters. Sensors 2014, 14, 2259-2279.

AMA Style

Segura C, Hernando J. 3D Joint Speaker Position and Orientation Tracking with Particle Filters. Sensors. 2014; 14(2):2259-2279.

Chicago/Turabian Style

Segura, Carlos; Hernando, Javier. 2014. "3D Joint Speaker Position and Orientation Tracking with Particle Filters." Sensors 14, no. 2: 2259-2279.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert