Title :
Quantizers with uniform decoders and channel-optimized encoders
Author :
Farber, Benjamin ; Zeger, Kenneth
Author_Institution :
Fair Isaac Co., San Diego, CA, USA
Abstract :
Scalar quantizers with uniform decoders and channel-optimized encoders are studied for a uniform source on [0,1] and binary symmetric channels. Two families of affine index assignments are considered: the complemented natural code (CNC), introduced here, and the natural binary code (NBC). It is shown that the NBC never induces empty cells in the quantizer encoder, whereas the CNC can. Nevertheless, we show that the asymptotic distributions of quantizer encoder cells for the NBC and the CNC are equal and are uniform over a proper subset of the source´s support region. Empty cells act as a form of implicit channel coding. An effective channel code rate associated with a quantizer designed for a noisy channel is defined and computed for the codes studied. By explicitly showing that the mean-squared error (MSE) of the CNC can be strictly smaller than that of the NBC, we also demonstrate that the NBC is suboptimal for a large range of transmission rates and bit error probabilities. This contrasts with the known optimality of the NBC when either both the encoder and decoder are not channel optimized, or when only the decoder is channel optimized.
Keywords :
binary codes; combined source-channel coding; decoding; error statistics; mean square error methods; optimisation; vector quantisation; CNC; MSE; NBC; affine index assignment; asymptotic distribution; binary symmetric channel; bit error probability; channel-optimized encoder; complemented natural code; data compression; decoder; mean-squared error; natural binary code; scalar quantizer; uniform source; Binary codes; Channel coding; Computer numerical control; Decoding; Error correction; Error probability; Niobium compounds; Quantization; Reflective binary codes; Statistics; Data compression; index assignment; quantization; source channel coding;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2005.862087