Author_Institution :
Dept. of Electr. Eng., Technion - Israel Inst. of Technol., Haifa, Israel
Abstract :
We consider the problem of universal decoding for arbitrary, finite-alphabet unknown channels in the random coding regime. For a given random coding distribution and a given class of metric decoders, we propose a generic universal decoder whose average error probability is, within a subexponential multiplicative factor, no larger than that of the best decoder within this class of decoders. Since the optimum, maximum likelihood (ML) decoder of the underlying channel is not necessarily assumed to belong to the given class of decoders, this setting suggests a common generalized framework for: 1) mismatched decoding, 2) universal decoding for a given family of channels, and 3) universal coding and decoding for deterministic channels using the individual sequence approach. The proof of our universality result is fairly simple, and it is demonstrated how some earlier results on universal decoding are obtained as special cases. We also demonstrate how our method extends to more complicated scenarios, like incorporation of noiseless feedback, the multiple access channel, and continuous alphabet channels.
Keywords :
channel coding; error statistics; maximum likelihood decoding; random codes; continuous alphabet channel; decoding metrics; deterministic channel; error probability; finite-alphabet unknown channel; generic universal decoder; maximum likelihood decoder; metric decoder; multiple access channel; noiseless feedback; random coding distribution; subexponential multiplicative factor; universal channel decoding; Channel coding; Entropy; Maximum likelihood decoding; Measurement; Vectors; Error exponents; Lempel–Ziv algorithm; feedback; finite–state machines; mismatched decoding; multiple access channel (MAC); universal decoding;