Voiceless Arabic vowels recognition using facial EMG

Abstract

This work attempts to recognize the Arabic vowels based on facial electromyograph (EMG) signals, to be used for people with speech impairment and for human computer interface. Vowels were selected since they are the most difficult letters to recognize by people in Arabic language. Twenty subjects (7 females and 13 males) were asked to pronounce three Arabic vowels continuously in a random order. Facial EMG signals were recorded over three channels from the three main facial muscles that are responsible for speech. The EMG signals are then pre-processed to eliminate noise and interference signals. Segmentation procedure was implemented to extract the time event that corresponds to each vowel based on a moving standard deviation window. The accuracy of the segmentation procedure was found to be 94%. The recognition of the vowels was carried out by extracting features from the EMG in three domains: the temporal, the spectral, and the time frequency using the wavelet packet transform. Classification of the extracted features was then finally performed using different classification methods implemented in the WEKA software. The random forest classifier with time frequency features showed the best performance with an accuracy of 77% evaluated using a 10-fold cross-validation.