Taiwan was a colony of Japan. How Taiwan and Japan view the past colonial experience and how they interpret the colonial period differently show the ways different peoples view their past. The different viewpoints and interpretations also reveal that the present situation reflects not only the way to interpret the colonial experience but also the direction of future development. This study analyzed and compared how junior high school textbooks of Taiwan and Japan write about Japan's colonial rule and its colony of Taiwan. The research explored the difference in the understanding of the colonial history between the two places, and the possible causes and meanings of that difference. This study found that, with respect to the difference in colonial memory, Taiwan textbooks include political, economic, social and cultural aspects with similar amount of coverage, while Japan textbooks include mainly the political aspect. This memory gap may have something to do with the level and the scale of colonized Taiwan, the change of political situations between Taiwan and China, and Japan's attitude towards its historical responsibility.