This paper is to discuss Kant's philosophy of natural science in relation to the second part of his Critique of judgment. We first summarize the treatment about the foundation of natural science in Critique of Pure Reason and Metaphysical Foundations of Natural Science: in the former work, Kant still discussed the possible conditions about the objects of general experiences; in the latter, he further dealt with the foundations of the objects of natural science. But these two works deviated from the approach of Critique of Judgment, which was no longer confined to theoretical reason but entered the realm of practical reason and teleology. Before we concentrate on the natural goal and the ultimate goal, emphasized in Critique of Judgment, to explore the foundation of natural science in the ideal of reason, we would point to similar ideas of goals and parallel issues in Aristotle's metaphysics to show Kant's inheritance and unique development of Aristotle. Finally, we will review earlier thoughts about natural science to show Kant's importance in the history of the philosophy of natural science; besides, we will summarize the phenomenological views about the philosophy of natural science to suggest another possibility to comprehend the nature of purposiveness.