Enhancing Deep Learning-Based Sentiment Analysis Using Static and Contextual Language Models

Khadija Mohamad; Kürşat Mustafa Karaoğlan

Article Details

Enhancing Deep Learning-Based Sentiment Analysis Using Static and Contextual Language Models

Authors:

Khadija Mohamad | Kürşat Mustafa Karaoğlan

Publisher:

Bitlis Eren University

Main Topics:

Engineering

Journal:

Bitlis Eren Üniversitesi Fen Bilimleri Dergisi Vol.12 Issue 3, pp.712-724

Document Type:

Article

Publication Date:

9/2023

Document Language:

English

Document ID (Org No.):

2001299143

pISSN:

2147-3129

Keywords:

Abstract:

 Sentiment Analysis SA is an essential task of Natural Language Processing and is used in various fields such as marketing, brand reputation control, and social media monitoring. The various scores generated by users in product reviews are essential feedback sources for businesses to discover their products positive or negative aspects. However, it takes work for businesses facing a large user population to accurately assess the consistency of the scores. Recently, automated methodologies based on Deep Learning DL, which utilize static and especially pre-trained contextual language models, have shown successful performances in SA tasks. To address the issues mentioned above, this paper proposes Multi-layer Convolutional Neural Network-based SA approaches using Static Language Models SLMs such as Word2Vec and GloVe and Contextual Language Models CLMs such as ELMo and BERT that can evaluate product reviews with ratings. Focusing on improving model inputs by using sentence representations that can store richer features, this study applied SLMs and CLMs to the inputs of DL models and evaluated their impact on SA performance. To test the performance of the proposed approaches, experimental studies were conducted on the Amazon dataset, which is publicly available and considered a benchmark dataset by most researchers. According to the results of the experimental studies, the highest classification performance was obtained by applying the BERT CLM with 82 test and 84 training accuracy scores. The proposed approaches can be applied to various domains SA tasks and provide insightful decision-making information.

 Sentiment Analysis SA is an essential task of Natural Language Processing and is used in various fields such as marketing, brand reputation control, and social media monitoring. The various scores generated by users in product reviews are essential feedback sources for businesses to discover their products positive or negative aspects. However, it takes work for businesses facing a large user population to accurately assess the consistency of the scores. Recently, automated methodologies based on Deep Learning DL, which utilize static and especially pre-trained contextual language models, have shown successful performances in SA tasks. To address the issues mentioned above, this paper proposes Multi-layer Convolutional Neural Network-based SA approaches using Static Language Models SLMs such as Word2Vec and GloVe and Contextual Language Models CLMs such as ELMo and BERT that can evaluate product reviews with ratings. Focusing on improving model inputs by using sentence representations that can store richer features, this study applied SLMs and CLMs to the inputs of DL models and evaluated their impact on SA performance. To test the performance of the proposed approaches, experimental studies were conducted on the Amazon dataset, which is publicly available and considered a benchmark dataset by most researchers. According to the results of the experimental studies, the highest classification performance was obtained by applying the BERT CLM with 82 test and 84 training accuracy scores. The proposed approaches can be applied to various domains SA tasks and provide insightful decision-making information.

 Sentiment Analysis SA is an essential task of Natural Language Processing and is used in various fields such as marketing, brand reputation control, and social media monitoring. The various scores generated by users in product reviews are essential feedback sources for businesses to discover their products positive or negative aspects. However, it takes work for businesses facing a large user population to accurately assess the consistency of the scores. Recently, automated methodologies based on Deep Learning DL, which utilize static and especially pre-trained contextual language models, have shown successful performances in SA tasks. To address the issues mentioned above, this paper proposes Multi-layer Convolutional Neural Network-based SA approaches using Static Language Models SLMs such as Word2Vec and GloVe and Contextual Language Models CLMs such as ELMo and BERT that can evaluate product reviews with ratings. Focusing on improving model inputs by using sentence representations that can store richer features, this study applied SLMs and CLMs to the inputs of DL models and evaluated their impact on SA performance. To test the performance of the proposed approaches, experimental studies were conducted on the Amazon dataset, which is publicly available and considered a benchmark dataset by most researchers. According to the results of the experimental studies, the highest classification performance was obtained by applying the BERT CLM with 82 test and 84 training accuracy scores. The proposed approaches can be applied to various domains SA tasks and provide insightful decision-making information.

 Sentiment Analysis SA is an essential task of Natural Language Processing and is used in various fields such as marketing, brand reputation control, and social media monitoring. The various scores generated by users in product reviews are essential feedback sources for businesses to discover their products positive or negative aspects. However, it takes work for businesses facing a large user population to accurately assess the consistency of the scores. Recently, automated methodologies based on Deep Learning DL, which utilize static and especially pre-trained contextual language models, have shown successful performances in SA tasks. To address the issues mentioned above, this paper proposes Multi-layer Convolutional Neural Network-based SA approaches using Static Language Models SLMs such as Word2Vec and GloVe and Contextual Language Models CLMs such as ELMo and BERT that can evaluate product reviews with ratings. Focusing on improving model inputs by using sentence representations that can store richer features, this study applied SLMs and CLMs to the inputs of DL models and evaluated their impact on SA performance. To test the performance of the proposed approaches, experimental studies were conducted on the Amazon dataset, which is publicly available and considered a benchmark dataset by most researchers. According to the results of the experimental studies, the highest classification performance was obtained by applying the BERT CLM with 82 test and 84 training accuracy scores. The proposed approaches can be applied to various domains SA tasks and provide insightful decision-making information.

Article Details

Enhancing Deep Learning-Based Sentiment Analysis Using Static and Contextual Language Models

Authors:

Khadija Mohamad | Kürşat Mustafa Karaoğlan

Publisher:

Bitlis Eren University

Main Topics:

Engineering

Journal:

Bitlis Eren Üniversitesi Fen Bilimleri Dergisi Vol.12 Issue 3, pp.712-724

Document Type:

Article

Publication Date:

9/2023

Document Language:

English

Document ID (Org No.):

2001299143

pISSN:

2147-3129

Deep learning

Natural language processing

Sentiment analysis

Static language models

Contextual language models

Issues

Article Details

Enhancing Deep Learning-Based Sentiment Analysis Using Static and Contextual Language Models

Authors: Khadija Mohamad | Kürşat Mustafa Karaoğlan

Publisher: Bitlis Eren University

Main Topics: Engineering

Journal: Bitlis Eren Üniversitesi Fen Bilimleri Dergisi Vol.12 Issue 3, pp.712-724

Document Type: Article

Publication Date: 9/2023

Document Language: English

Document ID (Org No.): 2001299143

pISSN: 2147-3129

Deep learning

Natural language processing

Sentiment analysis

Static language models

Contextual language models

Issues

Authors:

Khadija Mohamad | Kürşat Mustafa Karaoğlan

Publisher:

Bitlis Eren University

Main Topics:

Engineering

Journal:

Bitlis Eren Üniversitesi Fen Bilimleri Dergisi Vol.12 Issue 3, pp.712-724

Document Type:

Article

Publication Date:

9/2023

Document Language:

English

Document ID (Org No.):

2001299143

pISSN:

2147-3129