Peer evaluation of multi-attribute analysis techniques: Case of a light rail transit network choice

This paper attempts to present a method for differentiating between multi-attribute decision procedures and to identify some competent procedures for major decision problems, where a matrix of alternative-measure of effectiveness and a vector of weights for the latter are available. In this respect, several known multi-attribute analysis procedures are chosen, and the same procedures are exploited to evaluate themselves, based on some evaluation criteria. This is done from an engineering viewpoint and in the context of a transportation problem, using a real case light rail transit network choice problem for the City of Mashhad, and the results are presented. Two concepts have been proposed in this respect and used in this evaluation; peer evaluation and information evaluation, which are investigated in this paper. In the evaluation of five multi-attribute decision procedures, based on nine criteria, and with the help of these procedures themselves in the context of the case under study, the results revealed that these procedures found Electre, Linear Assignment, Simple Additive Weighting, TOPSIS, and Minkowski Distance better than others, in the same order as given. This is backed by a wide range of sensitivity analyses. Nevertheless, despite specific conclusions made regarding the better decision procedures among those evaluated, this paper finds its contribution mainly in the approach to such evaluations and choices.