It is the right time for elementary schools to put knowledge management (KM) into practice, and the school leaders also put more emphasis on the knowledge management activities. They hope to improve school effectiveness through impelling knowledge management activities. But when implementing knowledge management, there are some obstacles leading to gaps which probably influence school effectiveness. Therefore, through literature review, expert interviews and questionnaire, this study identifies five knowledge management gaps in elementary schools. The investigation results of this study also reveals that school effectiveness is significantly influenced by these management gaps. To make the suggestions correspondence to the need of schools, this study also interview the core executive staff in implementing knowledge management in some elementary schools. After combining the statistics and interview results, this study propose how knowledge management gaps affect school effectiveness and how managers eliminate the gaps. We expect the improvement of knowledge management activities can enhance school effectives more effectively.