As William Wordsworth calls himself "Nature's Priest," we tend to think that the relationship between nature and man in his poetic works is harmonious. This paper, however, attempts to tackle the problems resulting from such a tendency. In other words, are there really harmony and reciprocity between nature and man? Can we human beings really get what we expect from nature? Thus, this paper, using "I Wandered Lonely as a Cloud" and "Tintern Abbey". as examples, will investigate man's harmony with nature and the function of memory in Wordsworth's nature poems. It will end with the conclusion that while advocating love for nature, Wordsworth is in the end anxious about the harmony and reciprocity between nature and man and that one thing man can resort to may be his memory.