Using a core banking system as the example, this study aims to establish an evaluation model and the associated model construction support system to facilitate the vendor evaluation process. We review the literature and identify a group of consideration categories and their included factors. These factors are conformed to real world situations through a case study on a commercial bank at Taiwan. In the following survey, the weight allocation for these consideration factors is investigated from the banking community at Taiwan. A questionnaire based on the Analytical Hierarchy Process (AHP) is used to collect the comparative perceptions for the importance of these consideration factors. Through the AHP, the aggregated evaluation weights are calculated. Statistical analysis is conducted based on the perception differences among different groups of sample. Based on the evaluation model’ the decision-makers may adjust the evaluation weights of the consideration factors based on the ad-hoc needs for their banks. The comparative scores of the evaluated vendors are then calculated for the participating vendors. The study contributes to establish an AHP-based evaluation process and the associated model construction support system using the web technologies for the AHP levels construction and questionnaire survey. The similar approach can be applied to other kinds of information systems.