Assesing the Stability and Selection Performance of Feature Selection Methods Under Different Data Complexity

Omaimah Al Hosni; Andrew Starkey

doi:10.34028/iajit

Article Details

Assesing the Stability and Selection Performance of Feature Selection Methods Under Different Data Complexity

Authors:

Omaimah Al Hosni | Andrew Starkey

Publisher:

Zarqa University, Jordan

Journal:

The International Arab Journal of Information Technology (IAJIT) Vol.19 Issue 3, pp.442-455

Document Type:

Article

Publication Date:

1/1970

Document Language:

English

Document ID (Org No.):

2001388647

pISSN:

2309-4524

DOI:

10.34028/iajit

Keywords:

Abstract:

 Our study aims to investigate the stability and the selection accuracy of feature selection performance under different data complexity. The motivation behind this investigation is that there are significant contributions in the research community from examining the effect of complex data characteristics such as overlapping classes or non-linearity of the decision boundaries on the classification algorithm's performance; however, relatively few studies have investigated the stability and the selection accuracy of feature selection methods with such data characteristics. Also, this study is interested in investigating the interactive effects of the classes overlapped with other data challenges such as small sample size, high dimensionality associated with irrelevant features, and imbalance classes to provide meaningful insights into the root causes for feature selection methods misdiagnosing the relevant features among different real-world data challenges. This analysis will be extended to real-world data to guide the practitioners and researchers in choosing the correct feature selection methods that are more appropriate for a particular dataset. Our study outcomes indicate that using feature selection techniques with datasets of different characteristics may generate different subsets of features under variations to the training data showing that small sample size and overlapping classes have the highest impact on the stability and selection accuracy of feature selection performance, among other data challenges that have been investigated in this study. Also, in this study, we will provide a survey on the current state of research in the feature selection stability context to highlight the area that requires more attention for other researchers.

Article Details

Assesing the Stability and Selection Performance of Feature Selection Methods Under Different Data Complexity

Authors:

Omaimah Al Hosni | Andrew Starkey

Publisher:

Zarqa University, Jordan

Journal:

The International Arab Journal of Information Technology (IAJIT) Vol.19 Issue 3, pp.442-455

Document Type:

Article

Publication Date:

1/1970

Document Language:

English

Document ID (Org No.):

2001388647

pISSN:

2309-4524

DOI:

10.34028/iajit

Stability of feature selection

class overlapping

data characteristics

complex data

Issues

Article Details

Assesing the Stability and Selection Performance of Feature Selection Methods Under Different Data Complexity

Authors: Omaimah Al Hosni | Andrew Starkey

Publisher: Zarqa University, Jordan

Journal: The International Arab Journal of Information Technology (IAJIT) Vol.19 Issue 3, pp.442-455

Document Type: Article

Publication Date: 1/1970

Document Language: English

Document ID (Org No.): 2001388647

pISSN: 2309-4524

DOI: 10.34028/iajit

Stability of feature selection

class overlapping

data characteristics

complex data

Issues

Authors:

Omaimah Al Hosni | Andrew Starkey

Publisher:

Zarqa University, Jordan

Journal:

The International Arab Journal of Information Technology (IAJIT) Vol.19 Issue 3, pp.442-455

Document Type:

Article

Publication Date:

1/1970

Document Language:

English

Document ID (Org No.):

2001388647

pISSN:

2309-4524

DOI:

10.34028/iajit