This study aimed to investigate the effect of implementing ability grouping for freshman English at a university of technology in central Taiwan. A total of 1817 freshmen participated in the present study. The participants were divided into three levels, ranging from basic to advanced levels, according to their English scores on Technological & Vocational Education Joint College Entrance Examination. With the descriptive statistics and pair sample t test methods, it was found that after implementing ability grouping in freshman English instruction, participants, in general, performed better on their final exam. Participants’ final scores of the intermediate level and advanced level were higher than those of midterm exam. Yet, participants from the basic level did not show significant progress after joining ability grouping. The reasons why low achievers performed poor or even worse need further investigation. It was suggested that more studies should probe into the issues of ability grouping among technology colleges so as to better understand the effect of ability grouping for different levels of the students.