Religion is a human pursuit of transcendental and holy values, so as to rid the limits and various sufferings of human life and help to realize some infinite worth of our finite life. Freedom is also a human endeavor to retain what is not allowed to be deprived of as a human life. Freedom is also our capability that raises our life above the natural limitation to achieve a kind of infinite value. Religious freedom and freedom of speech are two major items of our human rights, and they are the fundamental values that a democratic government must provide and protect. In a sense, all freedom is expressed as through human speech and practice. Hence, freedom of religion and speech as freedom of expression are the ways that we could achieve the highest value of our life. They constitute the most important part of our fighting against political and social suppressions. In fact, both are historically twins born together and both are ways seeking protecting from religion and political power and persecutions. However, they are also forever enemies against each other. In this paper, I have argued not only from the religious goal in the liberation of human life that all killing and wars in the name of religion are anti-religious. It is both inconsistent and against our morality. I employ both Ronald Dworkin's theory of freedom and T.M. Scanlon's analysis of freedom and tolerance, and the introduction of Mill's principle of freedom to argue for a principle of toleration so that freedom of speech and religious toleration could be compatible. I further try to delineate the boundary of a public space for freedom of speech and religious toleration in order to construct a tolerant society so that both could be contained. Some strategies in dealing with possible conflicts between freedom, religion and politics in human societies are suggested. If intra-societal conflicts could be solved, it is reasonable that inter-religion and inter-nations kind of war could be eliminated and we could enjoy an eternal peace between all nations.