AUDIBLE (NORMAL) SPEECH AND INAUDIBLE MURMUR RECOGNITION USING NAM MICROPHONE (TuePmPO2)

Author(s) : Panikos Heracleous (Nara Institute of Science and Technology, Japan) Yoshitaka Nakajima (Nara Institute of Science and Technology, Japan) Akinobu Lee (Nara Institute of Science and Technology, Japan) Hiroshi Saruwatari (Nara Institute of Science and Technology, Japan) Kiyohiro Shikano (Nara Institute of Science and Technology, Japan)

Abstract : In this paper, we present audible (normal) speech and inaudible murmur hidden Markov models based automatic speech recognition using NAM microphone. The NAM (Non-Audible Murmur) microphone is a special device, which can be used for capturing inaudible murmur speech. The device is based on the stethoscope, which is used in medical science. By attaching the NAM microphone behind the talker's ear, we can receive very quietly uttered speech and perform automatic speech recognition in a conventional way. Privacy, robustness to environmental, and a useful tool for sound-impaired people noise belong to the advantages of the NAM microphone. Using adaptation techniques, we created hidden Markov models for inaudible speech and we performed automatic speech recognition. The achieved results are very promising, and prove the effectiveness of NAM microphone In this paper, we also introduce our work for recognizing normal speech using NAM microphone. The idea is to take advantage of noise robustness of NAM microphone. In our experiments, we achieved a 93.82% word accuracy in clean environment, and a 93.08% word accuracy in noisy environment. In this paper, we also introduce two techniques to intergrate inaudible murmur and audible speech recognition using NAM microphone. In both cases, we achieved a 92.01% word accuracy on average, which is a very promising result.

Menu