Recently, in major economies’ educational reform programs, there have been lots of subjects related to decentralization. Japan shifted power and authority from central government to local government by promoting decentralization in education field from late 1990s, and the autonomy in management was also expanded to school level. Because educational bureaucracy was changed by transferring power and stakeholders’ participation within the processes of decentralization, the main purpose of this article is to analyze Japan’s decentralization reforms and cases of bureaucracy change through five issues, which are 1. the educational administration system; 2. recent decentralization reforms in education; 3. concepts of education bureaucracy; 4. change in relationship between local government and school levels; 5. adjustments in organization structures. In the final part of the paper, some suggestions relevant to Taiwan are made, based on the implementation status of Japan case.