Frequency shift keyed narrowband interference rejection: optimal exponential weighting factor for the RLS algorithm

Cochannel narrowband interference can limit the performance of direct sequence spread spectrum (DSSS) and high frequency (HF) systems. Narrowband interference (NBI) can be single tone, chirped or frequency shift keyed (FSK) in nature and numerous techniques for its removal have been proposed. Linear adaptive prediction filters based on autoregressive modelling have been suggested owing to their ability to perform in a non-stationary environment. In the FSK narrowband interference case, adaptive filters are susceptible to excess residual errors owing to instantaneous frequency step changes and the finite convergence time required for the filter to adapt to a new interference frequency. The signal degradation owing to this type of interference becomes greater in high SNR regimes and has been found to be a function of the frequency parameters of the FSK interference signal. The paper discusses the convergence and frequency tracking properties of the recursive least squares (RLS) adaptive lattice filter using a posteriori estimation errors in the presence of FSK narrowband interference. An optimal exponential weighting factor that balances convergence time and steady state error is derived for this case of NBI. Results are compared to those of a previously proposed fast converging minimum frequency error (FCMFE) RLS lattice filter.