Backwards search in context bound text transformations

Petri M.; Culpepper J.S.; Puglisi S.J.; Navarro G.

Keywords: search, compression, communication, index, algorithms, data, transform, context, Indexing, (of, information), bound, (materials, working), Text-indexing, backwards, bwt, k-gram

Abstract

The Burrows-Wheeler Transform (bwt) is the basis for many of the most effective compression and self-indexing methods used today. A key to the versatility of the bwt is the ability to search for patterns directly in the transformed text. A backwards search for a pattern P can be performed on a transformed text by iteratively determining the range of suffixes that match P. The search can be further enhanced by constructing a wavelet tree over the output of the bwt in order to emulate a suffix array. In this paper, we investigate new algorithms for search derived from a variation of the bwt whereby rotations are only sorted to a depth k, commonly referred to as a context bound transform. Interestingly, this bwt variant can be used to mimic a k-gram index, which are used in a variety of applications that need to efficiently return occurrences in text position order. In this paper, we present the first backwards search algorithms on the k-bwt, and show how to construct a self-index containing many of the attractive properties of a k-gram index. © 2011 IEEE.

Más información

Título de la Revista: 1604-2004: SUPERNOVAE AS COSMOLOGICAL LIGHTHOUSES
Editorial: ASTRONOMICAL SOC PACIFIC
Fecha de publicación: 2011
Página de inicio: 82
Página final: 91
URL: http://www.scopus.com/inward/record.url?eid=2-s2.0-81255165005&partnerID=q2rCbXpz