Title :
Coding for a binary independent piecewise-identically-distributed source
Author :
Willems, Frans M. J.
Author_Institution :
Dept. of Electr. Eng., Eindhoven Univ. of Technol.
fDate :
11/1/1996 12:00:00 AM
Abstract :
Two weighting procedures are presented for compaction of output sequences generated by binary independent sources whose unknown parameter may occasionally change. The resulting codes need no knowledge of the sequence length T, i.e., they are strongly sequential, and also the number of parameter changes is unrestricted. The additional-transition redundancy of the first method was shown to achieve the Merhav lower bound, i.e., log T bits per transition. For the second method we could prove that additional-transition redundancy is not more than 3/2 log T bits per transition, which is more than the Merhav bound; however, the storage and computational complexity of this method are also more interesting than those of the first method. Simulations show that the difference in redundancy performance between the two methods is negligible
Keywords :
binary sequences; computational complexity; redundancy; sequential codes; source coding; Merhav lower bound; additional-transition redundancy; binary independent piecewise-identically-distributed source; binary independent sources; compaction; computational complexity; i.i.d. source; independent identically distributed source; output sequences; redundancy performance; sequential; storage; unknown parameter; weighting procedures; Arithmetic; Binary sequences; Compaction; Computational complexity; Computational modeling; Information theory; Noise reduction; Source coding;
Journal_Title :
Information Theory, IEEE Transactions on