Improving The Performance of Big Data Databases

Nzar Abdulqadir Ali; Dashne Raouf Arif

Article Details

Improving The Performance of Big Data Databases

Authors:

Nzar Abdulqadir Ali | Dashne Raouf Arif

Publisher:

Sulaimani Polytechnic University

Journal:

Kurdistan Journal of Applied Research Vol.4 Issue 2, pp.206-220

Document Type:

Article

Publication Date:

12/2019

Document Language:

English

Document ID (Org No.):

2001838362

pISSN:

2411-7706

Keywords:

Abstract:

 Real-time monitoring systems utilize two types of database, they are relational databases such as MySQL and non-relational databases such as MongoDB. A relational database management system (RDBMS) stores data in a structured format using rows and columns. It is relational because the values of the tables are connected. A non-relational database is a database that does not adopt the relational structure given by traditional.In recent years, this class of databases has also been referred to as Not only SQL (NoSQL). This paper discusses many comparisons that have been conducted on the execution time performance of types of databases (SQL and NoSQL). In SQL (Structured Query Language) databases different algorithms are used for inserting and updating data, such as indexing, bulk insert and multiple updating. However, in NoSQL different algorithms are used for inserting and updating operations such as default-indexing, batch insert, multiple updating and pipeline aggregation. As a result, firstly compared with related papers, this paper shows that the performance of both SQL and NoSQL can be improved. Secondly, performance can be dramatically improved for inserting and updating operations in the NoSQL database compared to the SQL database. To demonstrate the performance of the different algorithms for entering and updating data in SQL and NoSQL, this paper focuses on a different number of data sets and different performance results. The SQL part of the paper is conducted on 50,000 records to 3,000,000 records, while the NoSQL part of the paper is conducted on 50,000 to 16,000,000 documents (2GB) for NoSQL. In SQL, three million records are inserted within 606.53 seconds, while in NoSQL this number of documents is inserted within 67.87 seconds. For updating data, in SQL 300,000 records are updated within 271.17 seconds, while for NoSQL this number of documents is updated within just 46.02 seconds.
.

Article Details

Improving The Performance of Big Data Databases

Authors:

Nzar Abdulqadir Ali | Dashne Raouf Arif

Publisher:

Sulaimani Polytechnic University

Journal:

Kurdistan Journal of Applied Research Vol.4 Issue 2, pp.206-220

Document Type:

Article

Publication Date:

12/2019

Document Language:

English

Document ID (Org No.):

2001838362

pISSN:

2411-7706

Keywords: Big data

Real-time and SQL

NoSQL

Issues

Article Details

Improving The Performance of Big Data Databases

Authors: Nzar Abdulqadir Ali | Dashne Raouf Arif

Publisher: Sulaimani Polytechnic University

Journal: Kurdistan Journal of Applied Research Vol.4 Issue 2, pp.206-220

Document Type: Article

Publication Date: 12/2019

Document Language: English

Document ID (Org No.): 2001838362

pISSN: 2411-7706

Keywords: Big data

Real-time and SQL

NoSQL

Issues

Authors:

Nzar Abdulqadir Ali | Dashne Raouf Arif

Publisher:

Sulaimani Polytechnic University

Journal:

Kurdistan Journal of Applied Research Vol.4 Issue 2, pp.206-220

Document Type:

Article

Publication Date:

12/2019

Document Language:

English

Document ID (Org No.):

2001838362

pISSN:

2411-7706