Due to the impact of colonial rule in Taiwan, Taiwanese people had to change their habits on dog keeping. The colonial authorities regarded roaming dogs as the "enemy of the people," especially with regard to public health, and forced the people to end the previous mode of relationship with canines. How it could be achieved? This article discusses from three aspects. First, it examines how did the concept of "owned dog" and "homeless dog" be implemented in the daily lives of the people through legislation; secondly, it investigates the reality about the elimination of homeless and abandoned dogs in the name of dealing with rabies; finally, it analyzes the expansion of scope of elimination after the war between China and Japan (1937-1945). We find that Taiwanese dogs became homeless was a consequence of the idea that divided dogs into two major categories. The new rulers encouraged dog owners to be more responsible and it may help reduce the number of roaming dogs. However, the colonial authorities' plan to annihilate them is the most important reason why Taiwanese dogs became minor species. The reputation of the Japanese government about dealing with feral dogs is shocking, but it has allowed us to reflect on the materials that have evolved.