Using idioms would benefit a higher level of language perception, learning and application. It is also a kind of important and basic training in both reading and writing. However, presently, most platforms or software of Chinese idiom teaching and learning only offer static data inquiry or teaching resources, lack for students practicing environment. The purpose of this research is to propose an ontology-based Chinese idiom practice system framework. Firstly, we analyzed the multiple meaning of Chinese idioms to build the ontology of the Chinese idioms, and generalized the wrong sentence templates in order to design the feasible diagnosis mechanisms of the computer system. Then, we developed the ontology-based Chinese idiom practice system prototype. The system can offer the on-line teaching material of Chinese idioms, produce true-false, multiple-choice, and matching test items, and offer a platform that users can practice sentence-making with Chinese idioms under a given supposed situation. The system can also judge test results or diagnose user-making sentences to give feedbacks. This research can break through the restriction that the existing on-line Chinese idiom tests can only select the built-in test bank, and further offer the situational environment that applies idioms to make sentences. After finishing the prototype, this study applied quasi-experimental design to examine the system performance. The results indicated that the performance of the experimental group was higher than the control group and the students also perceived that the system is easy-to-use and useful.