Information Theoretic Approach for Knowledge Engineering and Intelligent Machines

Hierarchically Intelligent Control Systems are composed of three levels arranged according to the principle of Increasing Intelligence with Decreasing Precision. Their "intelligence" in performing and executing complex well-defined tasks is directly related to the derivation of a compatible measure that associates the intelligence of the higher levels with the precision of execution of the lower levels. Entropies, conditional entropies, and entropy-rates from n-dimensional information theory are concepts and measures well adapted for the study of these systems. A mathematical programming algorithm utilizing one step ahead entropies is used to approximate the optimal solution of the intelligent machine problem.