Research on using ANP to establish a performance assessment model for business intelligence systems

  • Authors:
  • Yu-Hsin Lin;Kune-Muh Tsai;Wei-Jung Shiang;Tsai-Chi Kuo;Chih-Hung Tsai

  • Affiliations:
  • Department of Industrial Engineering and Management, Ming-Hsin University of Science and Technology, 1 Hsinhsin Road, Hsinfong 30401, Hsin-Chu, Taiwan, ROC;Department of Logistics Management, National Kaohsiung First University of Science and Technology, No. 2, Jhuoyue Road, Nazih District, Kaohsiung, Taiwan, ROC;Department of Industrial Engineering, Chung Yuan Christian University 200, Chung Pei Road, Chung Li 32023, Taiwan, ROC;Department of Industrial Engineering and Management, Ming-Hsin University of Science and Technology, 1 Hsinhsin Road, Hsinfong 30401, Hsin-Chu, Taiwan, ROC;Department of Industrial Engineering and Management, Ta-Hwa Institute of Technology, 1 Ta-Hwa Road, Chung-Lin, Hsin-Chu, Taiwan, ROC

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2009

Quantified Score

Hi-index 12.06

Visualization

Abstract

In order to compete in the rigorous environment, the electronization has enabled business to deploy business intelligence (BI) systems for the purpose of decision-making. However, to avoid the ineffective experiences during the deployment, it is important to clarify the impact factors of a BI system and find out a suitable assessment method to evaluate the performance of BI systems. In this paper, an analytic network process (ANP) based assessment model was constructed to assess the effectiveness of BI systems. Furthermore, an expert questionnaire was used to filter out useful performance matrices, used as the sub-criteria of the ANP model. Finally, a real case was analyzed using the constructed ANP-based effectiveness assessment model for Business Intelligence systems. The results indicate that the most critical factors that impact the effectiveness of a BI system are: output information accuracy, conformity to the requirements, and support of organizational efficiency. Utilizing this model to assess the BI performance of the studied case, it reveals that 24% improvement in effectiveness has been reached, which consists with the perception of the management level. Therefore, this effectiveness assessment model can be used to evaluate the performances of a BI system. It can also provide performance indices and improvement directions for BI users and vendors, respectively, for the total succession in system effectiveness and satisfaction.