On the Limiting Distribution of Lempel-Ziv’78 Redundancy for Memoryless Sources - Publication - Bridge of Knowledge

Search

On the Limiting Distribution of Lempel-Ziv’78 Redundancy for Memoryless Sources

Abstract

We study the Lempel-Ziv'78 algorithm and show that its (normalized) redundancy rate tends to a Gaussian distribution for memoryless sources. We accomplish it by extending findings from our 1995 paper, in particular, by presenting a new simplified proof of the central limit theorem (CLT) for the number of phrases in the LZ'78 algorithm. We first analyze the asymptotic behavior of the total path length in the associated digital search tree built from independent sequences. Then, a renewal theory type argument yields CLT for LZ'78 scheme. Here, we extend our analysis of LZ'78 algorithm to present new results on the convergence of moments, moderate and large deviations, and CLT for the (normalized) redundancy. In particular, we confirm that the average redundancy rate decays as 1/log n, and we find that the variance is of order 1/n, where n is the length of the text.

Citations

  • 1

    CrossRef

  • 0

    Web of Science

  • 4

    Scopus

Authors (2)

  • Photo of  Philippe Jacquet

    Philippe Jacquet

    • . .
  • Photo of prof. dr inż. Wojciech Szpankowski

    Wojciech Szpankowski prof. dr inż.

    • Purdue University Department of Computer Science

Cite as

Full text

full text is not available in portal

Keywords

Details

Category:
Articles
Type:
artykuł w czasopiśmie wyróżnionym w JCR
Published in:
IEEE TRANSACTIONS ON INFORMATION THEORY no. 60, pages 6917 - 6930,
ISSN: 0018-9448
Language:
English
Publication year:
2014
Bibliographic description:
Jacquet P., Szpankowski W.: On the Limiting Distribution of Lempel-Ziv’78 Redundancy for Memoryless Sources// IEEE TRANSACTIONS ON INFORMATION THEORY. -Vol. 60, nr. 11 (2014), s.6917-6930
DOI:
Digital Object Identifier (open in new tab) 10.1109/tit.2014.2358679
Verified by:
Gdańsk University of Technology

seen 86 times

Recommended for you

Meta Tags