Scalable Construction of Text Indexes

10 Oct 2016  ·  Bingmann Timo, Gog Simon, Kurpicz Florian ·

The suffix array is the key to efficient solutions for myriads of string processing problems in different applications domains, like data compression, data mining, or Bioinformatics. With the rapid growth of available data, suffix array construction algorithms had to be adapted to advanced computational models such as external memory and distributed computing. In this article, we present five suffix array construction algorithms utilizing the new algorithmic big data batch processing framework Thrill, which allows us to process input sizes in orders of magnitude that have not been considered before.

PDF Abstract
No code implementations yet. Submit your code now

Categories


Data Structures and Algorithms Distributed, Parallel, and Cluster Computing

Datasets


  Add Datasets introduced or used in this paper