With the development of globalization and internationalization, English education has become more and more important in the educational system of every country. However, Japanese is known weak in using English, which doesn’t match its status as a well-developed country. In order to change the situation and promote Japanese English abilities, there are new reforms of English education undertaken since the announcement of "Action Plan to Cultivate 'Japanese with English Abilities", followed by "Action Plan" from the beginning of 21st century. By studying these new measures, some enlightenment beneficial to the present English education in China can be got. This paper will focus on elementary school English education in Japan and three aspects that China can learn from will be discussed, namely, globalization perspective, English activities(for teaching) and teacher programs. At the end, we will reflect on the elementary school English education in China, and some suggestions will be put forward.