After World War II in 1945, the Japanese withdrew from Taiwan; and after the civil war in China in 1949, the Nationalist Government retreated to Taiwan. A large number of military premises and factory buildings constructed during the Japanese Colonial Period became temporary accommodation for the national army that retreated to Taiwan. Later, in order to settle the national army, military dependents villages were constructed around Taiwan. After their co-existence with the surrounding Jhongjhen Village for 60 years, and in the face of the demolition of the military dependents villages, in this study, the military dependents village spaces in the idle factories of Japanese Navy's Hsinchu Navy Sixth Fuel Plant were selected to explore the evolutionary process of the idle factories transformed into living spaces. The purpose of this research is to explore how the settlers used the idle factories built during the Japanese occupation as residences, how to adapt to and integrate the existing space, or even change and achieve breakthroughs in the layout. Content analysis and qualitative interview were adopted as the research methods in this study. Through the phenomenological point of view, and with the space and time axis, a comprehensive review was conducted. The results show that after the settlers went through the stage of external social change, and with the increased internal use demand, the idle factory spaces were used to create the organic evolution of the different periods, thereby forming a very special type of military dependents village space.