The purpose of decision analysis is to achieve consistency among decision makers' choices, values, and judgments. The Analytical Hierarchy Process (AHP) was designed by T. L. Saaty as a decision making aid. In order to prioritize alternatives, the AHP used pairwise comparisons and transferred them from oral expression to numerical ratio scale, the fundamental scale (1-9), to determine their priority of relative importance. The translation from oral to ratio scale demonstrates a systematic bias that might cause errors in final ranking without decision makers' awareness. This paper used questionnaires and statistical analysis to examine this kind of bias. The results show that this bias does exist. This bias may cause 4.7~12.5% probability of failing to identify the best alternative for problems with 3~8 attributes.