The main purposes of this study were trying to perform the concept of decision analysis in a viewpoint for managing decision quality by utilizing multiple criteria decision making methods such as SMARTER-ROC in order to figure out the actual results of athletic annual awards of Chinese Professional Baseball League (CPBL) in 2007. The results of this study were not only finding out the lists of the best ten players of each fielding position, but using sensitive analysis to attest results' viability, and eventually constructing the decision making model of athletic annual awards. The conclusions would be important consultants for decision maker to improve management efficiency and practical implements.