A new compression algorithm for fast text search

Aydin CARUS; Altan MESUT

Article Details

A new compression algorithm for fast text search

Authors:

Aydin CARUS | Altan MESUT

Publisher:

TUBITAK

Journal:

Turkish Journal of Electrical Engineering and Computer Science 2016 Vol.24 Issue 5, pp.4355-4367

Document Type:

Article

Publication Date:

9/2016

Document Language:

Turkish

Document ID (Org No.):

2000741659

Frequency:

Bimonthly

eISSN:

1303-6203

pISSN:

1300-0632

Abstract:

 

We propose a new compression algorithm that compresses plain texts by using a dictionary-based model and a compressed string-matching approach that can be used with the compressed texts produced by this algorithm. The compression algorithm (CAFTS) can reduce the size of the texts to approximately 41% of their original sizes. The presented compressed string matching approach (SoCAFTS), which can be used with any of the known pattern matching algorithms, is compared with a powerful compressed string matching algorithm (ETDC) and a compressed string-matching tool (Lzgrep). Although the search speed of ETDC is very good in short patterns, it can only search for exact words and its compression performance differs from one natural language to another because of its word-based structure. Our experimental results show that SoCAFTS is a good solution when it is necessary to search for long patterns in a compressed document.

Article Details

A new compression algorithm for fast text search

Authors: Aydin CARUS | Altan MESUT

Publisher: TUBITAK

Journal: Turkish Journal of Electrical Engineering and Computer Science 2016 Vol.24 Issue 5, pp.4355-4367

Document Type: Article

Publication Date: 9/2016

Document Language: Turkish

Document ID (Org No.): 2000741659

Frequency: Bimonthly

eISSN: 1303-6203

pISSN: 1300-0632

Issues

Authors:

Aydin CARUS | Altan MESUT

Publisher:

TUBITAK

Journal:

Turkish Journal of Electrical Engineering and Computer Science 2016 Vol.24 Issue 5, pp.4355-4367

Document Type:

Article

Publication Date:

9/2016

Document Language:

Turkish

Document ID (Org No.):

2000741659

Frequency:

Bimonthly

eISSN:

1303-6203

pISSN:

1300-0632