Semantic relationship among knowledge units is the foundation of knowledge association,knowledge reorganization,knowledge mining,and automatic abstracting. Based on the clarification of the definition of knowledge unit and semantic relationship,the paper analyzes the types and representation methods of semantic relationship among knowledge units from the perspective of fine-grained knowledge unit,such as vocabulary and sentence(sentence group). The paper can provide some references for related researches.