The study of Yi-jing in Song dynasty placed a great deal of emphasis on the investigation of the formation of the universe and the pattern of mutability. It usually used numbers, symbols, and hieroglyphs象數圖書, and also the order and construct of directions and/or numbers方位數目 to explain the universe. In the same period, it's also a fashion for Buddhist scholars to use symbols, hieroglyphs, as well as Yi-jing's 易經 divinatory symbols 卦爻to concisely convey basic Buddhist thoughts. The affiliation of Hua Yen School with the study of Yi-jing advanced the Neo-Confucianism of the Song Dynasty. Such a relationship also gave the monks and Confucian scholars in the Ming Dynasty adequate reasons to use Buddhism to interpret Yi-jing, or vice versa. Moreover, scholars of classical prose 古文家 also used Yi-jing as a go-between between Confucianism and Buddhism. These phenomena have seldom been noted and thus are traced and explored in this paper.