Design of vector quantization networks by MDL-based principles

We develop a framework for vector quantization networks based on the minimum description length principle (MDL). This MDL framework is used to derive conditions for the removal of superfluous units from the network. Based on this we design a computationally efficient algorithm for finding the optimal number of reference vectors as well as their positions. We illustrate our approach on 2D clustering problems and present applications to image coding.