A Deep Learning Approach based on Ensemble Classification Pipeline and Interpretable Logical Rules for Bilingual Fake Speech Recognition

Emre Beray Boztepe; Bahadir Karasulu

Article Details

A Deep Learning Approach based on Ensemble Classification Pipeline and Interpretable Logical Rules for Bilingual Fake Speech Recognition

Authors:

Emre Beray Boztepe | Bahadir Karasulu

Publisher:

Gazi University

Main Topics:

Image Processing | Multimodal Analysis and Synthesis | Audio Processing | Deep Learning | Machine Learning (Other)

Journal:

Gazi University Journal of Science Vol.38 Issue 1, pp.75-97

Document Type:

Article

Publication Date:

1/2025

Document Language:

English

Document ID (Org No.):

2001341117

pISSN:

2147-1762

Keywords:

Abstract:

 The essential steps of our study are to quantify and classify the differences between real and fake speech signals. In this scope, the main aim is to use the salient feature learning ability of deep learning in our study. With the use of ensemble classification pipeline, the interpretable logical rules were used for generalized reasoning with the class activation maps to discriminate the different speech classes as correctly. Fake audio samples were generated by using Deep Convolutional Generative Adversarial Neural Network. Our experiments were conducted on three different language dataset such as Turkish, English languages and Bilingual. As a result of higher classification and recognition accuracy with the use of classification pipeline as compiled into a majority voting-based ensemble classifier, the experimental results were obtained for each individual language performance approximately as 90 for training and as 80.33 for testing stages for pipeline, and it reached as 73 for majority voting results considered together with the appropriate test cases as well. To extract semantically rich rules, an interpretable logical rules infrastructure was used to infer the correct fake speech from class activations of deep learnings generative model. Discussion and conclusion based on scientific findings are included in our study.

 The essential steps of our study are to quantify and classify the differences between real and fake speech signals. In this scope, the main aim is to use the salient feature learning ability of deep learning in our study. With the use of ensemble classification pipeline, the interpretable logical rules were used for generalized reasoning with the class activation maps to discriminate the different speech classes as correctly. Fake audio samples were generated by using Deep Convolutional Generative Adversarial Neural Network. Our experiments were conducted on three different language dataset such as Turkish, English languages and Bilingual. As a result of higher classification and recognition accuracy with the use of classification pipeline as compiled into a majority voting-based ensemble classifier, the experimental results were obtained for each individual language performance approximately as 90 for training and as 80.33 for testing stages for pipeline, and it reached as 73 for majority voting results considered together with the appropriate test cases as well. To extract semantically rich rules, an interpretable logical rules infrastructure was used to infer the correct fake speech from class activations of deep learnings generative model. Discussion and conclusion based on scientific findings are included in our study.

 The essential steps of our study are to quantify and classify the differences between real and fake speech signals. In this scope, the main aim is to use the salient feature learning ability of deep learning in our study. With the use of ensemble classification pipeline, the interpretable logical rules were used for generalized reasoning with the class activation maps to discriminate the different speech classes as correctly. Fake audio samples were generated by using Deep Convolutional Generative Adversarial Neural Network. Our experiments were conducted on three different language dataset such as Turkish, English languages and Bilingual. As a result of higher classification and recognition accuracy with the use of classification pipeline as compiled into a majority voting-based ensemble classifier, the experimental results were obtained for each individual language performance approximately as 90 for training and as 80.33 for testing stages for pipeline, and it reached as 73 for majority voting results considered together with the appropriate test cases as well. To extract semantically rich rules, an interpretable logical rules infrastructure was used to infer the correct fake speech from class activations of deep learnings generative model. Discussion and conclusion based on scientific findings are included in our study.

 The essential steps of our study are to quantify and classify the differences between real and fake speech signals. In this scope, the main aim is to use the salient feature learning ability of deep learning in our study. With the use of ensemble classification pipeline, the interpretable logical rules were used for generalized reasoning with the class activation maps to discriminate the different speech classes as correctly. Fake audio samples were generated by using Deep Convolutional Generative Adversarial Neural Network. Our experiments were conducted on three different language dataset such as Turkish, English languages and Bilingual. As a result of higher classification and recognition accuracy with the use of classification pipeline as compiled into a majority voting-based ensemble classifier, the experimental results were obtained for each individual language performance approximately as 90 for training and as 80.33 for testing stages for pipeline, and it reached as 73 for majority voting results considered together with the appropriate test cases as well. To extract semantically rich rules, an interpretable logical rules infrastructure was used to infer the correct fake speech from class activations of deep learnings generative model. Discussion and conclusion based on scientific findings are included in our study.

Article Details

A Deep Learning Approach based on Ensemble Classification Pipeline and Interpretable Logical Rules for Bilingual Fake Speech Recognition

Authors:

Emre Beray Boztepe | Bahadir Karasulu

Publisher:

Gazi University

Main Topics:

Image Processing | Multimodal Analysis and Synthesis | Audio Processing | Deep Learning | Machine Learning (Other)

Journal:

Gazi University Journal of Science Vol.38 Issue 1, pp.75-97

Document Type:

Article

Publication Date:

1/2025

Document Language:

English

Document ID (Org No.):

2001341117

pISSN:

2147-1762

Ensemble classifier

Machine learning

Deep learning

Speech recognition

Speech analysis

Issues

Article Details

A Deep Learning Approach based on Ensemble Classification Pipeline and Interpretable Logical Rules for Bilingual Fake Speech Recognition

Authors: Emre Beray Boztepe | Bahadir Karasulu

Publisher: Gazi University

Main Topics: Image Processing | Multimodal Analysis and Synthesis | Audio Processing | Deep Learning | Machine Learning (Other)

Journal: Gazi University Journal of Science Vol.38 Issue 1, pp.75-97

Document Type: Article

Publication Date: 1/2025

Document Language: English

Document ID (Org No.): 2001341117

pISSN: 2147-1762

Ensemble classifier

Machine learning

Deep learning

Speech recognition

Speech analysis

Issues

Authors:

Emre Beray Boztepe | Bahadir Karasulu

Publisher:

Gazi University

Main Topics:

Image Processing | Multimodal Analysis and Synthesis | Audio Processing | Deep Learning | Machine Learning (Other)

Journal:

Gazi University Journal of Science Vol.38 Issue 1, pp.75-97

Document Type:

Article

Publication Date:

1/2025

Document Language:

English

Document ID (Org No.):

2001341117

pISSN:

2147-1762