Detecting anomalies in constructed complex systems

It is well known that complex systems are difficult to design, implement, and analyze. Component-level verification has improved to the point that we can expect to produce formal or nearly formal verification analyses of all components of a complex system. What remains are the system-level verifications which we believe can be improved by our approach to system development. In earlier papers, we defined the wrapping integration infrastructure (C. Landauer and K.L. Bellman, 1996; 1998; 1999), which shows how a little bit of knowledge about the uses of the different resources goes a very long way towards using them properly, identifying anomalies and even monitoring their behavior. We first describe our knowledge based integration infrastructure, called "wrappings", then we describe some anomaly detection algorithms originally developed for verification and validation, of knowledge based systems, and finally, we show how systems organized using wrappings lend themselves to evaluation studies, both offline and online.