Research on using ANP to establish a performance assessment model for business intelligence systems

In order to compete in the rigorous environment, the electronization has enabled business to deploy business intelligence (BI) systems for the purpose of decision-making. However, to avoid the ineffective experiences during the deployment, it is important to clarify the impact factors of a BI system and find out a suitable assessment method to evaluate the performance of BI systems. In this paper, an analytic network process (ANP) based assessment model was constructed to assess the effectiveness of BI systems. Furthermore, an expert questionnaire was used to filter out useful performance matrices, used as the sub-criteria of the ANP model. Finally, a real case was analyzed using the constructed ANP-based effectiveness assessment model for Business Intelligence systems. The results indicate that the most critical factors that impact the effectiveness of a BI system are: output information accuracy, conformity to the requirements, and support of organizational efficiency. Utilizing this model to assess the BI performance of the studied case, it reveals that 24% improvement in effectiveness has been reached, which consists with the perception of the management level. Therefore, this effectiveness assessment model can be used to evaluate the performances of a BI system. It can also provide performance indices and improvement directions for BI users and vendors, respectively, for the total succession in system effectiveness and satisfaction.