Component-based information systems: toward a framework for evaluation

Information systems evaluation is problematic. It is noted to be under-researched in relation to development, is contentious in terms of the quantification, measurement and effort required, and there is a marked difference between theoretical development and practical use. Drawing on a critical review of the ´tradition´ in information systems evaluation, this paper applies the lessons learnt to the context of component-based development. In common with development approaches that have preceded components, there is consequently a danger that investment decisions fall prey to ´hype´, and there is evidence to suggest that there is considerable risk inherent in the migration to component-based systems. Such risk provides an opportunity to bridge the perceived chasm between information systems development and evaluation in three ways: firstly, by integrating business-driven evaluation with the development approach at an early stage of the adoption process; secondly, by using this integration to lessen the perceived effort of evaluation; and thirdly, by making evaluation a dynamic and ongoing process. With this in mind, this paper discusses the demands of evaluating component-based development in the context of a conceptual framework that concentrates on gaining a pluralistic understanding of the information needs of stakeholders.