Title :
An Integrated Decision Support Model to Assess Reviewers for Research Project Selection
Author :
Xu, Wei ; Du, Wei ; Ma, Jian ; Wang, Wei ; Liu, Qian
Author_Institution :
Sch. of Inf., Renmin Univ. of China, Beijing, China
Abstract :
Reviewers play a significant role in research project selection, because their opinions will have great influence on the decision of the projects which will be funded. Current methods mainly focus on the evaluation of reviewers´ competitiveness in a certain research areas, while ignoring the performance of reviewers whether is suitable to review a proposal. In this paper, a group decision support model is proposed to assess reviewers´ performance in peer review process. In the proposed model, competitiveness and relevance of reviewers are considered to evaluate reviewers. It integrates analytic hierarchy process (AHP), scoring method and fuzzy linguistic processing. An illuminating example is used to show the effectiveness of the proposed method. The results find that the proposed method is a reasonable method to assess reviewers, and it can be potentially applied to reviewer evaluation in the National Natural Science Foundation of China (NSFC).
Keywords :
decision making; fuzzy set theory; group decision support systems; project management; research and development; National Natural Science Foundation of China; analytic hierarchy process; fuzzy linguistic processing; group decision support model; integrated decision support model; peer review process; research project selection; reviewer assessment; reviewer competitiveness; reviewer relevance; scoring method; Atmospheric measurements; Cities and towns; Educational institutions; Government; Particle measurements; Pragmatics; Proposals; Research project selection; decision support model; reviewer assessment; reviewer assignment;
Conference_Titel :
System Science (HICSS), 2012 45th Hawaii International Conference on
Conference_Location :
Maui, HI
Print_ISBN :
978-1-4577-1925-7
Electronic_ISBN :
1530-1605
DOI :
10.1109/HICSS.2012.103