The current study aims to describe how the cultural metaphor has taken effect in the visual experiences of various literary texts since the introduction of Western visual devices such as cameras and movies to China in the late 16th century. Visual modernity, highly related to the Western visual devices, has become an important issue in the studies within the past decade of early Republic literature and culture. Past scholars have focused mainly on how the visual experiences brought by the new visual devices have impacted on the traditional visual experience in China, and how this impact has influenced literature and culture. These studies only imply that there is one universal idea of visual modernity and that new visual experiences are completely rejected as incompatible or completely replace outdated modes of visual experience. However, it is known from the perspective of cultural translation that a new concept can be accepted after interpreted through a known epistemological framework, which will connect the concept with the given historical environment. In view of this, this study explores the traditional metaphoric elements and the epistemological framework behind the formulation of Chinese visual modernity and analyzes the origin and the process of the reappearance and creation of the visual devices in narrative texts of the 16th and 19th centuries.