A reduced state variant of maximum likelihood sequence detection attaining optimum performance for high signal-to-noise ratios

In the detection of -level pulse-amplitude modulation (PAM) signals transmitted over a noisy linear -symbol memory channel, maximum likelihood sequence detection (MLSD) is asymptotically optimum in the sense that the exponent of the probability of symbol error in the limit of small noise is the largest that can be achieved by any detector. A reduced state detection (RSD) is developed with the aim of mitigating the computational complexity of MLSD while attaining the same error exponent as MLSD. In RSD, for each baud, the recent received signal levels delineate a certain list of the most probable of the possible states. Retention of only the paths threading through these most probable states is the key to success of RSD. Suppose it is required that the number of states retained at any time not exceed . When is less than the number of states required for RSD, it is shown how to modify RSD so that no more than states are retained and how to assess the degradation of the error exponent.