This article provides an overview of the development of the Basic Competence Test (BCTEST). As an important part of the reform for secondary education in Taiwan, BCTEST is a standardized test designed to measure the educational achievement of junior high school graduates. To ensure high reliability and validity of this assessment, we established a complete test construction procedure and continue to refine it throughout the years. This paper puts emphasis on the following components: the test item developing and banking procedure, computer-assisted test assembly, the scaling method, and the scoring mechanism of the Chinese writing assessment, as well as its related on-line scoring system. Information from this paper is expected to offer useful and valuable insights into hands-on design and operation of large-scale standardized testing for test practitioners and psychometric researchers. Finally, with the possible implementation of a twelve-year compulsory education program in the near future, the BCTEST is sure to take on a more important role in the new educational evaluation and admission policy system.