Any language, spoken or signed, evolves with the birth, growth and death of the society where it is spoken. Peircean’s three philosophical categories can be applied to the analysis of the cultural differences between the hearing and the deaf communities, which bring about the cognitive similarities and differences between these two communities. In Taiwan, the hearing majority and the deaf minority can communicate and socialize through spoken Chinese and sign language, respectively. Language change of Taiwanese sigh language reflects the choice of using sign language for the deaf. Although the cultural form of Taiwanese sign language differs from that of spoken Chinese, both are faced with similar factors which lead to language change. Sign language is visual-spatial, but cyber-speak among the deaf community has been evolving to adapt to the limited computer screen size and the fixed position of the webcam. Through close examination of the definition, content, function, and effect of language, this paper reveals that although the language difference between spoken language and sign language lies mainly in voice and the lack thereof, it is sufficient to bring about cultural differences in the hearing and deaf communities.