Toward a theory of information processing

Information processing is performed when a system preserves aspects of the information encoded in the input and removes other aspects. We describe an approach to quantify such information processing based on applying controlled changes to the input and observing the corresponding outputs. Information-theoretic distance measures-those that reflect the data processing theorem-are calculated on the input and output separately and compared. Properties of the resulting information transfer ratio are used to quantify the system´s fundamental information processing properties.