PLoS One 2011 30;6(6):e21588. Epub 2011 Jun 30.

Signal Processing Lab, IEETA/DETI, University of Aveiro, Aveiro, Portugal.

A finite-context (Markov) model of order k yields the probability distribution of the next symbol in a sequence of symbols, given the recent past up to depth k. Markov modeling has long been applied to DNA sequences, for example to find gene-coding regions. With the first studies came the discovery that DNA sequences are non-stationary: distinct regions require distinct model orders. Since then, Markov and hidden Markov models have been extensively used to describe the gene structure of prokaryotes and eukaryotes. However, to our knowledge, a comprehensive study about the potential of Markov models to describe complete genomes is still lacking. We address this gap in this paper. Our approach relies on (i) multiple competing Markov models of different orders (ii) careful programming techniques that allow orders as large as sixteen (iii) adequate inverted repeat handling (iv) probability estimates suited to the wide range of context depths used. To measure how well a model fits the data at a particular position in the sequence we use the negative logarithm of the probability estimate at that position. The measure yields information profiles of the sequence, which are of independent interest. The average over the entire sequence, which amounts to the average number of bits per base needed to describe the sequence, is used as a global performance measure. Our main conclusion is that, from the probabilistic or information theoretic point of view and according to this performance measure, multiple competing Markov models explain entire genomes almost as well or even better than state-of-the-art DNA compression methods, such as XM, which rely on very different statistical models. This is surprising, because Markov models are local (short-range), contrasting with the statistical models underlying other methods, where the extensive data repetitions in DNA sequences is explored, and therefore have a non-local character.

## Download full-text PDF |
Source |
---|---|

http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0021588 | PLOS |

http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3128062 | PMC |

December 2011

4 Reads

markov models

24

dna sequences

12

multiple competing

12

markov

9

finite-context markov

8

models

8

competing markov

8

performance measure

8

statistical models

8

complete genomes

8

sequence

5

genomes well

4

iii adequate

4

allow orders

4

entire genomes

4

sixteen iii

4

orders large

4

large sixteen

4

well better

4

repeat handling

4

Compression of DNA sequences.

S Grumbach et al.

1993

S Grumbach et al.

1993

Significantly lower entropy estimates for natural DNA sequences.

D Loewenstern et al.

1997

D Loewenstern et al.

1997

A compression algorithm for DNA sequences.

X Chen et al.

*IEEE Engineering in Medicine and Biology Magazine* 2001

X Chen et al.

DNA sequence compression using the normalized maximum likelihood model for discrete regression.

I Tabus et al.

2003

I Tabus et al.

2003

An efficient normalized maximum likelihood algorithm for DNA sequence compression.

G Korodi et al.

*ACM Trans on Information Systems* 2005

G Korodi et al.

DNA compression challenge revisited.

B Behzadi et al.

2005

B Behzadi et al.

2005

Normalized maximum likelihood model of order-1 for the compression of DNA sequences.

G Korodi et al.

2007

G Korodi et al.

2007

A simple statistical algorithm for biological sequence compression.

MD Cao et al.

2007

MD Cao et al.

2007