The concept “spirit wanders with nature” is a typical discourse as well as a creative ideal in Chinese literary theoretical thought, but is also allows multiple theoretical modes of interpretation. This paper chooses an approach through the textual mediation in meaningful expression, and tries to reconstruct the conditions of interpreting Shensi (Spiritual thinking or imagination) and the idea of “spirit wanders with nature.” By exploring the linking function in literary imagination which bridges the imaginative subject and the nature of the world, I try to open the free dimension being conditioned by textual limitation must be involved in the innate structure of textual constitution, which includes historicity and literal training. On the other hand, this freedom is also rooted in the human connection with the world; therefore, free imagination in literature excludes unlimited pastas. Finally, focusing on the literary imagination, the two limitations-textual mediation and worldly connection-are the fundamental conditions in literature as a system of meaning and expression.