The use of pairwise comparisons for decision making may lead to grossly inaccurate results

Document Type

Article

Publication Date

12-1-2024

Abstract

Pairwise comparison matrices (also known as Saaty matrices) in conjunction with a finite discrete scale for their quantification, are considered by many as efficient and effective means for eliciting personal preferences from decision makers. This study demonstrates that under a highly optimistic assumption, called the ultra-accurate decision maker (UADM) assumption, the results obtained from such matrices may be grossly inaccurate. The true ranking of the compared entities may be altered and / or an abnormal rank grouping may occur when processing pairwise comparison matrices. The rates that such effects take place are exceptionally dramatic. Given that this occurs under the deliberately highly optimistic conditions of the UADM assumption, the implication is that under real-life circumstances these rates can be even more dramatic. The results are supported with theoretical and extensive computational investigations. The computational investigations are based on three novel and powerful tests introduced for the first time in this study. This is the first needed step to better understand the potential and limitations of pairwise comparisons before one attempts to remedy this problem.

Publication Source (Journal or Book title)

Computers and Industrial Engineering

This document is currently not available here.

Share

COinS