Next Article in Journal
Whispering Gallery Mode Thermometry
Previous Article in Journal
An Accurate Direction Finding Scheme Using Virtual Antenna Array via Smartphones
Open AccessArticle

Towards Contactless Silent Speech Recognition Based on Detection of Active and Visible Articulators Using IR-UWB Radar

by 1,2 and 1,2,*
1
School of Integrated Technology, College of Engineering, Yonsei University, 85 Songdogwahak-ro, Yeonsu-gu, Incheon 21983, Korea
2
Yonsei Institute of Convergence Technology, Yonsei University, 85 Songdogwahak-ro, Yeonsu-gu, Incheon 21983, Korea
*
Author to whom correspondence should be addressed.
Academic Editor: Ba-Ngu Vo
Sensors 2016, 16(11), 1812; https://doi.org/10.3390/s16111812
Received: 3 August 2016 / Revised: 25 October 2016 / Accepted: 26 October 2016 / Published: 29 October 2016
(This article belongs to the Section Physical Sensors)
People with hearing or speaking disabilities are deprived of the benefits of conventional speech recognition technology because it is based on acoustic signals. Recent research has focused on silent speech recognition systems that are based on the motions of a speaker’s vocal tract and articulators. Because most silent speech recognition systems use contact sensors that are very inconvenient to users or optical systems that are susceptible to environmental interference, a contactless and robust solution is hence required. Toward this objective, this paper presents a series of signal processing algorithms for a contactless silent speech recognition system using an impulse radio ultra-wide band (IR-UWB) radar. The IR-UWB radar is used to remotely and wirelessly detect motions of the lips and jaw. In order to extract the necessary features of lip and jaw motions from the received radar signals, we propose a feature extraction algorithm. The proposed algorithm noticeably improved speech recognition performance compared to the existing algorithm during our word recognition test with five speakers. We also propose a speech activity detection algorithm to automatically select speech segments from continuous input signals. Thus, speech recognition processing is performed only when speech segments are detected. Our testbed consists of commercial off-the-shelf radar products, and the proposed algorithms are readily applicable without designing specialized radar hardware for silent speech processing. View Full-Text
Keywords: IR-UWB radar; contactless silent speech recognition; articulators’ detection IR-UWB radar; contactless silent speech recognition; articulators’ detection
Show Figures

Figure 1

MDPI and ACS Style

Shin, Y.H.; Seo, J. Towards Contactless Silent Speech Recognition Based on Detection of Active and Visible Articulators Using IR-UWB Radar. Sensors 2016, 16, 1812. https://doi.org/10.3390/s16111812

AMA Style

Shin YH, Seo J. Towards Contactless Silent Speech Recognition Based on Detection of Active and Visible Articulators Using IR-UWB Radar. Sensors. 2016; 16(11):1812. https://doi.org/10.3390/s16111812

Chicago/Turabian Style

Shin, Young H.; Seo, Jiwon. 2016. "Towards Contactless Silent Speech Recognition Based on Detection of Active and Visible Articulators Using IR-UWB Radar" Sensors 16, no. 11: 1812. https://doi.org/10.3390/s16111812

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop