Towards a generic framework for the evaluation of knowledge-based infrastructures

This paper introduces a generic framework for the evaluation of the quality of knowledge-based technologies. The evaluation process is described, including steps that have to be completed in advance, such as the selection of appropriate criteria, metrics, and references. The flexibility of this framework enables its implementation for a wide range of technologies. The authors present its applicability on the basis of the evaluation of Ontology Reasoning components, developed within the Core Technology Cluster (CTC) of the THESEUS program (http://theseus-programm.de/home/). The main target of the evaluation framework points to novel approaches to improve the quality of the technologies used for the acquisition, processing and better use of the knowledge from multiple sources.