Audiovisual Speaker Identification Based on Lip and Speech Modalities

N. A.

doi:10.34028/iajit

Article Details

Audiovisual Speaker Identification Based on Lip and Speech Modalities

Authors:

N. A.

Publisher:

Zarqa University, Jordan

Journal:

The International Arab Journal of Information Technology (IAJIT) Vol.14 Issue 1, pp.92-103

Document Type:

Article

Publication Date:

1/2017

Document Language:

English

Document ID (Org No.):

2001389028

pISSN:

2309-4524

DOI:

10.34028/iajit

Abstract:

 In this article, we pre sent a bimodal speaker identification method, which integrates both acoustic and visual 
features and where the two audiovisual stream modalities are processed in parallel. We also propose a fusion technique that 
combines the two modalities to make the final recognition decision. Experiments are conducted on an audiovisual dataset 
containing the 28 Arabic syllables pronounced by ten speakers. Results show the importance of the visual information that is 
provided by Discrete Cosine Transform (DCT) and Discret e Wavelet Transform (DWT) in addition to the audio information 
corresponding to the Mel Frequency Cepstral Coefficients (MFCC) and Perceptual Linear Predictive (PLP). Furthermore, 
some artificial neural networks such as Multilayer Perceptron (MLP) and Radi al Basis Function (RBF) were investigated and 
tested successfully in this dataset by presenting good recognition performances with serial concatenation for the acoustic and 
visual vectors.

Article Details

Audiovisual Speaker Identification Based on Lip and Speech Modalities

Authors: N. A.

Publisher: Zarqa University, Jordan

Journal: The International Arab Journal of Information Technology (IAJIT) Vol.14 Issue 1, pp.92-103

Document Type: Article

Publication Date: 1/2017

Document Language: English

Document ID (Org No.): 2001389028

pISSN: 2309-4524

DOI: 10.34028/iajit

Issues

Authors:

N. A.

Publisher:

Zarqa University, Jordan

Journal:

The International Arab Journal of Information Technology (IAJIT) Vol.14 Issue 1, pp.92-103

Document Type:

Article

Publication Date:

1/2017

Document Language:

English

Document ID (Org No.):

2001389028

pISSN:

2309-4524

DOI:

10.34028/iajit