The use of pairwise comparisons for decision making may lead to grossly inaccurate results
Document Type
Article
Publication Date
12-1-2024
Abstract
Pairwise comparison matrices (also known as Saaty matrices) in conjunction with a finite discrete scale for their quantification, are considered by many as efficient and effective means for eliciting personal preferences from decision makers. This study demonstrates that under a highly optimistic assumption, called the ultra-accurate decision maker (UADM) assumption, the results obtained from such matrices may be grossly inaccurate. The true ranking of the compared entities may be altered and / or an abnormal rank grouping may occur when processing pairwise comparison matrices. The rates that such effects take place are exceptionally dramatic. Given that this occurs under the deliberately highly optimistic conditions of the UADM assumption, the implication is that under real-life circumstances these rates can be even more dramatic. The results are supported with theoretical and extensive computational investigations. The computational investigations are based on three novel and powerful tests introduced for the first time in this study. This is the first needed step to better understand the potential and limitations of pairwise comparisons before one attempts to remedy this problem.
Publication Source (Journal or Book title)
Computers and Industrial Engineering
Recommended Citation
Triantaphyllou, E., & Yanase, J. (2024). The use of pairwise comparisons for decision making may lead to grossly inaccurate results. Computers and Industrial Engineering, 198 https://doi.org/10.1016/j.cie.2024.110653